00000001:02000400:2.0F:1789672576.666259:0:3292:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_hostid 00000001:02000400:2.0:1789672596.792200:0:3513:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789672599.353382:0:3572:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 367 MB/s 00000001:01000000:3.0:1789672599.602912:0:3572:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 575 MB/s 00000001:01000000:2.0:1789672599.853689:0:3572:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3671 MB/s 00000020:02000000:3.0:1789672600.823973:0:3604:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g9373f0b 00000400:02000000:0.0F:1789672602.293056:0:3619:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.150@tcp [8/256/0/180] 00008000:02000000:2.0:1789672606.532183:0:3769:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789672672.851594:0:5738:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing load_modules_local 00000020:01000004:1.0F:1789672687.688470:0:6488:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789672687.688488:0:6488:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789672687.688490:0:6488:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789672687.688636:0:6488:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000004daa7149 00000080:02000400:1.0:1789672687.688646:0:6488:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789672687.699047:0:6488:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789672687.699062:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789672687.699091:0:6488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000eaa7e033) 00000020:00000080:1.0:1789672687.699110:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789672687.760002:0:6488:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789672687.760091:0:6488:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1789672687.810938:0:6488:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789672687.811182:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789672687.811191:0:6488:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789672687.811204:0:6488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c78c4f8c9964b1d 00000020:01000004:1.0:1789672687.811211:0:6488:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789672687.811215:0:6488:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789672687.811220:0:6488:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004daa7149 from MGS 00000020:01000004:1.0:1789672687.811224:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789672687.811234:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000004e1daaa) 00000020:00000080:1.0:1789672687.811246:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789672687.811324:0:6488:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004daa7149 from MGS, refs=2 00080000:01000000:1.0:1789672687.811330:0:6488:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789672687.811336:0:6488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c78c4f8c9964b2b 00000100:00100000:1.0:1789672687.811442:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789672687.811579:0:6488:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789672687.811586:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789672687.814934:0:6488:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789672687.814946:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789672687.818351:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789672687.818504:0:6488:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789672687.818510:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789672687.819257:0:6488:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789672687.819264:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789672687.820567:0:6488:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789672687.820578:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789672687.823569:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672687.823574:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672687.823576:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672687.823835:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672687.823838:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672687.823840:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672687.824696:0:6488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789672687.827209:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789672688.073930:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2619 MB/s 00000001:01000000:2.0:1789672688.328000:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2811 MB/s 00000001:01000000:2.0:1789672688.578561:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 351 MB/s 00000001:01000000:3.0:1789672688.828490:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 483 MB/s 00010000:00010000:1.0:1789672688.837634:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1789672688.841630:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1789672688.860111:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789672688.860986:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789672688.861007:0:6488:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789672688.861052:0:6488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789672688.861217:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789672688.861241:0:6488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789672688.861566:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789672688.862120:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789672688.862128:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789672688.875697:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789672688.875718:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789672688.878384:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789672688.878398:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789672688.879761:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789672688.879781:0:6488:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.150@tcp' 00000020:01000004:0.0:1789672688.879783:0:6488:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789672688.879836:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.150@tcp (typ=mgc) 00000020:00000080:0.0:1789672688.879857:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.150@tcp (000000004ebd9319) 00000020:00000080:0.0:1789672688.879875:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789672688.880018:0:6488:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009c5e5447@MGC192.168.201.150@tcp: add connection 192.168.201.150@tcp at head 00010000:00010000:0.0:1789672688.880209:0:6488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.150@tcp-0 is initialized 00000040:01000000:0.0:1789672688.880216:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789672688.880437:0:6508:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789672688.886626:0:6509:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789672688.887113:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.150@tcp (uuid 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7) 00000020:00000080:0.0:1789672688.887140:0:6488:0:(genops.c:1384:class_connect()) connect: client 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7, cookie 0x6c78c4f8c9964b39 00000100:00080000:0.0:1789672688.887153:0:6488:0:(import.c:545:import_select_connection()) MGC192.168.201.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789672688.887166:0:6488:0:(import.c:666:import_select_connection()) MGC192.168.201.150@tcp: import 000000009c5e5447 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789672688.887356:0:6488:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000eec03880 x1876607738314880/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789672688.887486:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eec03880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3634:1876607738314880:0@lo:250: 00000100:00100000:1.0:1789672688.887600:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672688.887857:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738314880 00000100:00100000:2.0:1789672688.887866:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738314880 00000100:00100000:2.0:1789672688.887918:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789672688.887925:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000acf36bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3634:x1876607738314880:12345-0@lo:250: 00010000:00080000:2.0:1789672688.887953:0:6504:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:2.0:1789672688.889293:0:6504:0:(genops.c:1384:class_connect()) connect: client 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7, cookie 0x6c78c4f8c9964b40 00000100:00080000:2.0:1789672688.889461:0:6504:0:(import.c:65:import_set_state_nolock()) 000000005d7ad13b : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789672688.890793:0:6488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7->MGS 00000020:01000004:0.0:1789672688.890824:0:6488:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789672688.890849:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789672688.890865:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000006429a2d) 00000020:00000080:0.0:1789672688.890885:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789672688.898509:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000acf36bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:3634:x1876607738314880:12345-0@lo:250: Request processed in 10570us (10897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672688.898529:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789672688.905158:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789672688.905401:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789672688.905408:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789672688.909147:0:3634:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789672688.909171:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.150@tcp: connect to target with instance 0 00000100:00080000:1.0:1789672688.909193:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789672688.909199:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789672688.909204:0:3634:0:(import.c:65:import_set_state_nolock()) 000000009c5e5447 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789672688.909209:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789672688.909220:0:3634:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789672688.909230:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eec03880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3634:1876607738314880:0@lo:250: 00000100:00100000:1.0:1789672688.912172:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789672688.912202:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789672688.915200:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789672688.915225:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789672688.916544:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789672688.916988:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789672688.916994:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789672688.921148:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789672688.922265:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789672688.988789:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789672688.989119:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789672688.989125:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789672688.990616:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789672688.990631:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789672688.991514:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789672688.991728:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789672688.991734:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789672688.992392:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789672688.992401:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789672688.993249:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789672688.993440:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789672688.993446:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789672688.996054:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789672688.996070:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789672689.005362:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789672689.005549:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789672689.005556:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789672689.014551:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789672689.014566:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789672689.046590:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789672689.047501:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789672689.047509:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789672689.055112:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789672689.055128:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789672689.064054:0:6488:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789672689.064077:0:6488:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789672689.065432:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789672689.065458:0:6488:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789672689.065464:0:6488:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789672689.065553:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789672689.065587:0:6488:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.150@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789672689.065591:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789672689.065596:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789672689.065598:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789672689.065599:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789672689.065600:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789672689.065601:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789672689.065602:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789672689.065604:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789672689.065605:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789672689.065606:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789672689.065608:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789672689.065609:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789672689.065611:0:6488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789672689.065613:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789672689.065614:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789672689.065615:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789672689.065616:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789672689.065617:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789672689.065618:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789672689.065618:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789672689.065619:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789672689.065620:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789672689.065621:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789672689.065622:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789672689.065623:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789672689.065646:0:6488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789672689.065915:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000269e0dbd pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738315008:0@lo:253: 00000100:00100000:0.0:1789672689.066069:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672689.066159:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 0000000014fabbf2 going to sleep for 11 seconds 00000100:00100000:1.0:1789672689.066297:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738315008 00000100:00100000:1.0:1789672689.066311:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738315008 00000100:00100000:1.0:1789672689.066382:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789672689.066390:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004315e5f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:6488:x1876607738315008:12345-0@lo:253: 20000000:01000000:1.0:1789672689.066435:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789672689.066438:0:6507:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789672689.066931:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789672689.067072:0:6507:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789672689.067443:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789672689.070290:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789672689.070911:0:6507:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789672689.070915:0:6507:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789672689.070922:0:6507:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789672689.070925:0:6507:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789672689.070938:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789672689.071402:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789672689.072597:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789672689.072626:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789672689.072650:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789672689.072908:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789672689.072927:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789672689.073081:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789672689.073100:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789672689.073117:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789672689.073122:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789672689.073133:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789672689.073137:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789672689.073149:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789672689.073164:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789672689.073281:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789672689.073288:0:6507:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789672689.073296:0:6507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789672689.073418:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789672689.073429:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789672689.073443:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789672689.073457:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789672689.073470:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789672689.073479:0:6507:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789672689.073504:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789672689.073513:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789672689.073525:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789672689.073540:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789672689.073555:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789672689.073564:0:6507:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789672689.073586:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789672689.073593:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789672689.073606:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789672689.073620:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789672689.074050:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789672689.074081:0:6507:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789672689.074090:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1789672689.079811:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1789672689.080360:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1789672689.080394:0:6507:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.150@tcp for mdt 20000000:01000000:0.0:1789672689.080397:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:0.0:1789672689.080436:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1789672689.080444:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789672689.080458:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1789672689.080464:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:0.0:1789672689.080478:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1789672689.080485:0:6507:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789672689.080501:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1789672689.080530:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1789672689.080558:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789672689.080562:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789672689.080566:0:6507:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789672689.080639:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789672689.080642:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789672689.081551:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1789672689.081947:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789672689.082049:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1789672689.082069:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1789672689.082080:0:6507:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789672689.082082:0:6507:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789672689.083197:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1789672689.083383:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1789672689.083401:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1789672689.083412:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1789672689.083420:0:6507:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789672689.083423:0:6507:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1789672689.083427:0:6507:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789672689.083429:0:6507:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789672689.083434:0:6507:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789672689.083440:0:6507:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789672689.083886:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1789672689.084025:0:6507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789672689.092484:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1789672689.092526:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1789672689.092534:0:6507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1789672689.092549:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789672689.092569:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b4e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.092583:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b4e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.092591:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b4e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.092595:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b4e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.092599:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b4e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.092604:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b4e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.092607:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000097739a6d already unused, calling callback (00000000f7a32c66) 00010000:00010000:0.0:1789672689.092610:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b4e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.092614:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b4e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.092622:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b4e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.092626:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b4e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.092638:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b4e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789672689.092649:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789672689.099570:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004315e5f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:6488:x1876607738315008:12345-0@lo:253: Request processed in 33172us (33492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672689.099590:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789672689.099730:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000269e0dbd pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738315008:0@lo:253: 10000000:01000000:1.0:1789672689.099746:0:6488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789672689.099749:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789672689.099751:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789672689.099752:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789672689.099753:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789672689.099754:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789672689.099755:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789672689.099757:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789672689.099758:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789672689.099760:0:6488:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789672689.099761:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789672689.099763:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789672689.099781:0:6488:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004daa7149 from lustre-MDT0000 10000000:01000000:1.0:1789672689.099814:0:6488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789672689.099817:0:6488:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789672689.099832:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cfc499cb380 10000000:01000000:1.0:1789672689.099837:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789672689.099845:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cfc499cb380 from 1 10000000:01000000:1.0:1789672689.099847:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789672689.099902:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 000000005f02944e/0x6c78c4f8c9964b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672689.099918:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 000000005f02944e/0x6c78c4f8c9964b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672689.099927:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 000000005f02944e/0x6c78c4f8c9964b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672689.099947:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fea4478b pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738315136:0@lo:101: 00000100:00100000:1.0:1789672689.100090:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672689.100242:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af161507 going to sleep for 11 seconds 00000100:00100000:2.0:1789672689.100318:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738315136 00000100:00100000:2.0:1789672689.100328:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738315136 00000100:00100000:2.0:1789672689.100402:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789672689.100410:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000034bc90c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:6488:x1876607738315136:12345-0@lo:101: 00010000:00010000:2.0:1789672689.100423:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672689.100447:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002e81380d/0x6c78c4f8c9964b5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964b55 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.100482:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002e81380d/0x6c78c4f8c9964b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964b55 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.100492:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002e81380d/0x6c78c4f8c9964b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964b55 expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.100501:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002e81380d, rc 0) 00000100:00100000:2.0:1789672689.100541:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000034bc90c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+6:6488:x1876607738315136:12345-0@lo:101: Request processed in 133us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672689.100548:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789672689.100601:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fea4478b pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738315136:0@lo:101: 00010000:00010000:1.0:1789672689.100613:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 000000005f02944e/0x6c78c4f8c9964b55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964b5c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672689.100622:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 000000005f02944e/0x6c78c4f8c9964b55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964b5c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672689.100725:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fea4478b pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738315264:0@lo:501: 00000100:00100000:1.0:1789672689.100751:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672689.101455:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af161507 going to sleep for 11 seconds 00000100:00100000:0.0:1789672689.101937:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738315264 00000100:00100000:0.0:1789672689.101946:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738315264 00000100:00100000:0.0:1789672689.102053:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789672689.102062:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ff9b948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+6:6488:x1876607738315264:12345-0@lo:501: 00000100:00100000:0.0:1789672689.102444:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ff9b948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+6:6488:x1876607738315264:12345-0@lo:501: Request processed in 383us (1692us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789672689.102452:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789672689.102606:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fea4478b pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738315264:0@lo:501: 10000000:01000000:1.0:1789672689.102643:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789672689.102682:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 000000005f02944e/0x6c78c4f8c9964b55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964b5c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672689.102693:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 000000005f02944e/0x6c78c4f8c9964b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964b5c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672689.102720:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfc44f3d800 10000000:01000000:1.0:1789672689.102725:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789672689.102729:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cfc44f3d800 10000000:01000000:1.0:1789672689.102731:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789672689.102733:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cfc44f3d800 from 1 10000000:01000000:1.0:1789672689.102735:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789672689.102756:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000da1543e2/0x6c78c4f8c9964b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672689.102760:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000da1543e2/0x6c78c4f8c9964b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672689.102768:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000da1543e2/0x6c78c4f8c9964b63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672689.102783:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fea4478b pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738315392:0@lo:101: 00000100:00100000:1.0:1789672689.102814:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672689.102851:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af161507 going to sleep for 11 seconds 00000100:00100000:0.0:1789672689.103107:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738315392 00000100:00100000:0.0:1789672689.103112:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738315392 00000100:00100000:0.0:1789672689.103140:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789672689.103147:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d594afb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+6:6488:x1876607738315392:12345-0@lo:101: 00010000:00010000:0.0:1789672689.103157:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672689.103171:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000037e757e2/0x6c78c4f8c9964b6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964b63 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.103349:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000037e757e2/0x6c78c4f8c9964b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964b63 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.103359:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000037e757e2/0x6c78c4f8c9964b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964b63 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.103381:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000037e757e2, rc 0) 00000100:00100000:0.0:1789672689.103419:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d594afb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+7:6488:x1876607738315392:12345-0@lo:101: Request processed in 273us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672689.103423:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789672689.108163:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fea4478b pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738315392:0@lo:101: 00010000:00010000:2.0:1789672689.108197:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000da1543e2/0x6c78c4f8c9964b63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964b6a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.108211:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000da1543e2/0x6c78c4f8c9964b63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964b6a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672689.108325:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789672689.108384:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000da1543e2/0x6c78c4f8c9964b63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964b6a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.108392:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000da1543e2/0x6c78c4f8c9964b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964b6a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672689.108400:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789672689.108405:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789672689.108412:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cfc44f3d800 10000000:01000000:2.0:1789672689.108415:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789672689.108427:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789672689.108430:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789672689.108480:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000c0bb2983/0x6c78c4f8c9964b71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.108487:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000c0bb2983/0x6c78c4f8c9964b71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.108496:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000c0bb2983/0x6c78c4f8c9964b71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672689.108514:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088d4aec0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738315520:0@lo:101: 00000100:00100000:2.0:1789672689.108583:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672689.108719:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b89a89a going to sleep for 11 seconds 00000100:00100000:0.0:1789672689.109095:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738315520 00000100:00100000:0.0:1789672689.109102:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738315520 00000100:00100000:0.0:1789672689.109156:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789672689.109163:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007b6e9799 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+7:6488:x1876607738315520:12345-0@lo:101: 00010000:00010000:0.0:1789672689.109178:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672689.109192:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964b71 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.109429:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964b71 expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.109443:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964b71 expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.109452:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000097739a6d, rc 0) 00000100:00100000:0.0:1789672689.109509:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007b6e9799 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+8:6488:x1876607738315520:12345-0@lo:101: Request processed in 347us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672689.109516:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789672689.109594:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088d4aec0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738315520:0@lo:101: 00010000:00010000:2.0:1789672689.109605:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000c0bb2983/0x6c78c4f8c9964b71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964b78 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.109613:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000c0bb2983/0x6c78c4f8c9964b71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964b78 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672689.109706:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088d4aec0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738315648:0@lo:501: 00000100:00100000:2.0:1789672689.109730:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672689.109746:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b89a89a going to sleep for 11 seconds 00000100:00100000:1.0:1789672689.109859:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738315648 00000100:00100000:1.0:1789672689.109864:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738315648 00000100:00100000:1.0:1789672689.109911:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789672689.109916:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000df98dafc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+8:6488:x1876607738315648:12345-0@lo:501: 00000100:00100000:1.0:1789672689.110030:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000df98dafc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+9:6488:x1876607738315648:12345-0@lo:501: Request processed in 113us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672689.110036:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789672689.110203:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088d4aec0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738315648:0@lo:501: 00000100:00100000:2.0:1789672689.110238:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088d4aec0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738315776:0@lo:503: 00000100:00100000:2.0:1789672689.110280:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672689.110298:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b89a89a going to sleep for 11 seconds 00000100:00100000:1.0:1789672689.110395:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738315776 00000100:00100000:1.0:1789672689.110399:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738315776 00000100:00100000:1.0:1789672689.110424:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789672689.110433:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035d8bbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+9:6488:x1876607738315776:12345-0@lo:503: 00000100:00100000:1.0:1789672689.110504:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035d8bbd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+9:6488:x1876607738315776:12345-0@lo:503: Request processed in 71us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672689.110510:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789672689.110600:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088d4aec0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738315776:0@lo:503: 00000100:00100000:0.0:1789672689.111299:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f345d6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6534:1876607738315904:0@lo:502: 00000100:00100000:0.0:1789672689.111339:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672689.111396:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 0000000095814e31 going to sleep for 11 seconds 00000100:00100000:2.0:1789672689.111439:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738315904 00000100:00100000:2.0:1789672689.111444:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738315904 00000100:00100000:2.0:1789672689.111511:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789672689.111519:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000150e9185 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+9:6534:x1876607738315904:12345-0@lo:502: 00000100:00100000:2.0:1789672689.111617:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000150e9185 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+9:6534:x1876607738315904:12345-0@lo:502: Request processed in 99us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672689.111624:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789672689.111703:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f345d6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6534:1876607738315904:0@lo:502: 00000020:01000000:0.0:1789672689.111734:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672689.111744:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672689.111746:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789672689.111751:0:6534:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789672689.111754:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789672689.111766:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000036eef40f) 00000020:00000080:0.0:1789672689.111781:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789672689.111787:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789672689.111871:0:6534:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789672689.111878:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c78c4f8c9964b86 00000020:00000080:0.0:1789672689.112238:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789672689.112243:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672689.112247:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672689.112248:0:6534:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789672689.112251:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672689.112255:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672689.112256:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789672689.112259:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789672689.112266:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000005825955b) 00000020:00000080:0.0:1789672689.112275:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789672689.112279:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789672689.112280:0:6534:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789672689.112283:0:6534:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789672689.112288:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789672689.112345:0:6534:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004daa7149 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789672689.112392:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a50981a9) 00000020:00000080:0.0:1789672689.112411:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789672689.112479:0:6534:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789672689.112485:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c78c4f8c9964b9b 00000020:00000080:0.0:1789672689.112576:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789672689.112583:0:6534:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789672689.112588:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6c78c4f8c9964ba2 00080000:01000000:0.0:1789672689.112593:0:6534:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789672689.112602:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c78c4f8c9964ba9 00080000:10000000:0.0:1789672689.113058:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1789672689.113542:0:6534:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1789672689.118256:0:6534:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1789672689.172051:0:6534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1789672689.172426:0:6534:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789672689.174797:0:6534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789672689.175159:0:6534:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789672689.180246:0:6534:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000010751982) 00000020:00000080:1.0:1789672689.180270:0:6534:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789672689.180359:0:6534:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789672689.180365:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c78c4f8c9964bb7 00000020:00000080:3.0:1789672689.181009:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789672689.181873:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1789672689.192745:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1789672689.195051:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1789672689.205325:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1789672689.207909:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1789672689.210301:0:6534:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1789672689.215023:0:6534:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6c78c4f8c9964bbe 00000020:00000080:1.0:1789672689.215546:0:6534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789672689.215559:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672689.215565:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672689.215567:0:6534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789672689.215571:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672689.215574:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672689.215576:0:6534:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789672689.215579:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789672689.215580:0:6534:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789672689.215582:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672689.215584:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672689.215586:0:6534:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789672689.215594:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672689.215599:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672689.215600:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789672689.215605:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789672689.215642:0:6534:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789672689.215743:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000214c013b pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6534:1876607738316032:0@lo:502: 00000100:00100000:1.0:1789672689.215836:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672689.215886:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 0000000018c5f289 going to sleep for 11 seconds 00000100:00100000:0.0:1789672689.216299:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738316032 00000100:00100000:0.0:1789672689.216307:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738316032 00000100:00100000:0.0:1789672689.216356:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789672689.216365:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001cf226df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+9:6534:x1876607738316032:12345-0@lo:502: 00000100:00100000:0.0:1789672689.216515:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001cf226df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+9:6534:x1876607738316032:12345-0@lo:502: Request processed in 151us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672689.216524:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789672689.216624:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000214c013b pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6534:1876607738316032:0@lo:502: 00000020:01000000:3.0:1789672689.216696:0:6534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789672689.216702:0:6534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672689.216703:0:6534:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1789672689.216706:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789672689.217002:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789672689.217029:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789672689.217052:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000c0bb2983/0x6c78c4f8c9964b71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964b78 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.217064:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000c0bb2983/0x6c78c4f8c9964b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964b78 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672689.217071:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfc44f3d800 from 1 10000000:01000000:2.0:1789672689.217074:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789672689.217107:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 000000008970bfbf/0x6c78c4f8c9964bc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.217114:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 000000008970bfbf/0x6c78c4f8c9964bc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.217123:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 000000008970bfbf/0x6c78c4f8c9964bc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672689.217140:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088d4aec0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738316160:0@lo:101: 00000100:00100000:2.0:1789672689.217178:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672689.217211:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 000000006470d25e going to sleep for 11 seconds 00000100:00100000:0.0:1789672689.217345:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738316160 00000100:00100000:0.0:1789672689.217351:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738316160 00000100:00100000:0.0:1789672689.217387:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789672689.217394:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000014a15bd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+9:6488:x1876607738316160:12345-0@lo:101: 00010000:00010000:0.0:1789672689.217405:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672689.217417:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000002580f3f/0x6c78c4f8c9964bcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964bc5 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.217439:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000002580f3f/0x6c78c4f8c9964bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964bc5 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.217450:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000002580f3f/0x6c78c4f8c9964bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964bc5 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.217458:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000002580f3f, rc 0) 00000100:00100000:0.0:1789672689.217499:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000014a15bd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+10:6488:x1876607738316160:12345-0@lo:101: Request processed in 106us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672689.217506:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789672689.217602:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088d4aec0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738316160:0@lo:101: 00010000:00010000:3.0:1789672689.217615:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 000000008970bfbf/0x6c78c4f8c9964bc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964bcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672689.217624:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 000000008970bfbf/0x6c78c4f8c9964bc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964bcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672689.218939:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000070d55b61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738316288:0@lo:256: 00000100:00100000:3.0:1789672689.219022:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672689.219055:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069ea91ac going to sleep for 11 seconds 00000100:00100000:1.0:1789672689.219356:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738316288 00000100:00100000:1.0:1789672689.219364:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738316288 00000100:00100000:1.0:1789672689.219397:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789672689.219404:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fa9acee1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+10:6488:x1876607738316288:12345-0@lo:256: 20000000:01000000:1.0:1789672689.219423:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789672689.219429:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789672689.219512:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fa9acee1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+10:6488:x1876607738316288:12345-0@lo:256: Request processed in 108us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672689.219519:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789672689.220166:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000070d55b61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738316288:0@lo:256: 10000000:01000000:3.0:1789672689.223234:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789672689.223342:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 000000008970bfbf/0x6c78c4f8c9964bc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964bcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672689.223360:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 000000008970bfbf/0x6c78c4f8c9964bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964bcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672689.223410:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc44f3d800 from 1 10000000:01000000:3.0:1789672689.223414:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789672689.223473:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 000000004dcb6424/0x6c78c4f8c9964bd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672689.223481:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 000000004dcb6424/0x6c78c4f8c9964bd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672689.223492:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 000000004dcb6424/0x6c78c4f8c9964bd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672689.223516:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000070d55b61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738316416:0@lo:101: 00000100:00100000:3.0:1789672689.223593:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672689.223671:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069ea91ac going to sleep for 11 seconds 00000100:00100000:2.0:1789672689.224525:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738316416 00000100:00100000:2.0:1789672689.224535:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738316416 00000100:00100000:2.0:1789672689.224592:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789672689.224601:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c926b636 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+10:6488:x1876607738316416:12345-0@lo:101: 00010000:00010000:2.0:1789672689.224615:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672689.224632:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006ee5bcbf/0x6c78c4f8c9964bda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964bd3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.224703:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006ee5bcbf/0x6c78c4f8c9964bda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964bd3 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.224715:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006ee5bcbf/0x6c78c4f8c9964bda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964bd3 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.224724:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006ee5bcbf, rc 0) 00000100:00100000:2.0:1789672689.224782:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c926b636 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+11:6488:x1876607738316416:12345-0@lo:101: Request processed in 183us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672689.224790:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789672689.232780:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000070d55b61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738316416:0@lo:101: 00010000:00010000:3.0:1789672689.232817:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 000000004dcb6424/0x6c78c4f8c9964bd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964bda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672689.232842:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 000000004dcb6424/0x6c78c4f8c9964bd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964bda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672689.232945:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000070d55b61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738316544:0@lo:501: 00000100:00100000:3.0:1789672689.233030:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672689.233104:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069ea91ac going to sleep for 11 seconds 00000100:00100000:2.0:1789672689.233219:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738316544 00000100:00100000:2.0:1789672689.233227:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738316544 00000100:00100000:2.0:1789672689.233288:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789672689.233298:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb6a4716 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+11:6488:x1876607738316544:12345-0@lo:501: 00000100:00100000:2.0:1789672689.233484:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb6a4716 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+11:6488:x1876607738316544:12345-0@lo:501: Request processed in 188us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672689.233492:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789672689.233618:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000070d55b61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738316544:0@lo:501: 00000100:00100000:0.0:1789672689.233650:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f345d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738316672:0@lo:503: 00000100:00100000:0.0:1789672689.233729:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672689.233750:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 000000000ff9ed00 going to sleep for 11 seconds 00000100:00100000:2.0:1789672689.233817:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738316672 00000100:00100000:2.0:1789672689.233833:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738316672 00000100:00100000:2.0:1789672689.233861:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789672689.233875:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ad599760 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+11:6488:x1876607738316672:12345-0@lo:503: 00000040:00080000:2.0:1789672689.233908:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789672689.233944:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ad599760 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+11:6488:x1876607738316672:12345-0@lo:503: Request processed in 70us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672689.233951:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789672689.234094:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f345d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738316672:0@lo:503: 00000040:00080000:0.0:1789672689.235134:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789672689.235459:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789672689.235488:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789672689.242328:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 000000004dcb6424/0x6c78c4f8c9964bd3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964bda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.242350:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 000000004dcb6424/0x6c78c4f8c9964bd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964bda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672689.242458:0:6488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789672689.242462:0:6488:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfc44f3d800 10000000:01000000:2.0:1789672689.242464:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfc44f3d800 10000000:01000000:2.0:1789672689.242469:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789672689.242475:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfc44f3d800 from 1 10000000:01000000:2.0:1789672689.242479:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789672689.242519:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 000000007eec6889/0x6c78c4f8c9964be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.242528:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 000000007eec6889/0x6c78c4f8c9964be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.242538:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 000000007eec6889/0x6c78c4f8c9964be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672689.242562:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000197cfd96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738316800:0@lo:101: 00000100:00100000:2.0:1789672689.242634:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672689.243173:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 000000006015a3ae going to sleep for 11 seconds 00000100:00100000:0.0:1789672689.245460:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738316800 00000100:00100000:0.0:1789672689.245477:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738316800 00000100:00100000:0.0:1789672689.245555:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789672689.245566:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f1a4dd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+11:6488:x1876607738316800:12345-0@lo:101: 00010000:00010000:0.0:1789672689.245586:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672689.245605:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000592a527b/0x6c78c4f8c9964be8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964be1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.245634:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000592a527b/0x6c78c4f8c9964be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964be1 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.245646:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000592a527b/0x6c78c4f8c9964be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964be1 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.245681:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000592a527b, rc 0) 00000100:00100000:0.0:1789672689.245930:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f1a4dd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:6488:x1876607738316800:12345-0@lo:101: Request processed in 366us (3295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672689.245937:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789672689.246080:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000197cfd96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738316800:0@lo:101: 00010000:00010000:3.0:1789672689.246101:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 000000007eec6889/0x6c78c4f8c9964be1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964be8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672689.246110:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 000000007eec6889/0x6c78c4f8c9964be1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964be8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672689.246187:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009c808586 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738316928:0@lo:501: 00000100:00100000:3.0:1789672689.246221:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672689.246259:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 000000003a16efa6 going to sleep for 11 seconds 00000100:00100000:1.0:1789672689.246319:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738316928 00000100:00100000:1.0:1789672689.246325:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738316928 00000100:00100000:1.0:1789672689.246349:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789672689.246355:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003597c53c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:6488:x1876607738316928:12345-0@lo:501: 00000100:00100000:1.0:1789672689.246481:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003597c53c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:6488:x1876607738316928:12345-0@lo:501: Request processed in 126us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672689.246488:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789672689.246613:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009c808586 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738316928:0@lo:501: 00000100:00100000:3.0:1789672689.246642:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009c808586 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738317056:0@lo:503: 00000100:00100000:3.0:1789672689.246725:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672689.246744:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 000000003a16efa6 going to sleep for 11 seconds 00000100:00100000:1.0:1789672689.246845:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738317056 00000100:00100000:1.0:1789672689.246850:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738317056 00000100:00100000:1.0:1789672689.246875:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789672689.246881:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000067fd3a9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:6488:x1876607738317056:12345-0@lo:503: 00000100:00100000:1.0:1789672689.246978:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000067fd3a9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:6488:x1876607738317056:12345-0@lo:503: Request processed in 98us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672689.246986:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789672689.247218:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009c808586 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738317056:0@lo:503: 00000100:00100000:3.0:1789672689.247591:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009c808586 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6539:1876607738317184:0@lo:502: 00000100:00100000:3.0:1789672689.247629:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672689.247832:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738317184 00000100:00100000:2.0:1789672689.247839:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738317184 00000100:00100000:2.0:1789672689.247875:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789672689.247882:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b589e6d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:6539:x1876607738317184:12345-0@lo:502: 00000100:00100000:2.0:1789672689.248071:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b589e6d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:6539:x1876607738317184:12345-0@lo:502: Request processed in 189us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672689.248080:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789672689.248135:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bfc5c3d5 going to sleep for 11 seconds 00000100:00100000:3.0:1789672689.248149:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009c808586 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6539:1876607738317184:0@lo:502: 00000020:01000004:3.0:1789672689.248202:0:6539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789672689.248225:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c4a7cefc) 00000020:00000080:3.0:1789672689.248246:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789672689.248345:0:6539:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004daa7149 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789672689.248349:0:6539:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004daa7149 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789672689.248352:0:6539:0:(obd_mount.c:710:lustre_put_lsi()) put 000000004daa7149 4 00010000:00080000:3.0:1789672689.248391:0:6539:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000ba6f34e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789672689.254401:0:6539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789672689.258165:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789672689.258213:0:6539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789672689.258227:0:6539:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6c78c4f8c9964bf6 00000100:00080000:3.0:1789672689.258239:0:6539:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789672689.258250:0:6539:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000ba6f34e using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789672689.258288:0:6539:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009c808586 x1876607738317312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789672689.258308:0:6539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789672689.258377:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009c808586 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876607738317312:0@lo:38: 00000100:00100000:1.0:1789672689.258448:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672689.264015:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058b9f1d2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6539:1876607738317440:0@lo:502: 00000100:00100000:1.0:1789672689.264104:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672689.264147:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067f58491 going to sleep for 11 seconds 00000100:00100000:1.0:1789672689.264167:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738317440 00000100:00100000:1.0:1789672689.264173:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738317440 00000100:00100000:1.0:1789672689.264222:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789672689.264230:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009c4e90ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:6539:x1876607738317440:12345-0@lo:502: 00000100:00100000:1.0:1789672689.264345:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009c4e90ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:6539:x1876607738317440:12345-0@lo:502: Request processed in 116us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672689.264352:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789672689.264401:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058b9f1d2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6539:1876607738317440:0@lo:502: 00000040:00080000:1.0:1789672689.264433:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789672689.266677:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789672689.266727:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789672689.266740:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 000000007eec6889/0x6c78c4f8c9964be1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964be8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.266753:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 000000007eec6889/0x6c78c4f8c9964be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964be8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789672689.266814:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789672689.266817:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789672689.266818:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672689.266828:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672689.266829:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672689.266831:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672689.266832:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789672689.266833:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789672689.266835:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789672689.266836:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789672689.266837:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672689.266838:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789672689.266842:0:6488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789672689.266844:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789672689.266845:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789672689.266846:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672689.266847:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672689.266848:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672689.266855:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672689.266856:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789672689.266857:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789672689.266858:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789672689.266859:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789672689.266859:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672689.266860:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789672689.266884:0:6488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789672689.266902:0:6488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009636d98f pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738317568:0@lo:253: 00000100:00100000:2.0:1789672689.267085:0:6488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672689.267127:0:6488:0:(client.c:2716:ptlrpc_set_wait()) set 000000006015a3ae going to sleep for 11 seconds 00000100:00100000:1.0:1789672689.268067:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738317568 00000100:00100000:1.0:1789672689.268078:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738317568 00000100:00100000:1.0:1789672689.268127:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789672689.268135:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb185c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:6488:x1876607738317568:12345-0@lo:253: 20000000:01000000:1.0:1789672689.268167:0:6504:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789672689.268181:0:6504:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789672689.271140:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738317312 00000100:00100000:0.0:1789672689.271155:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738317312 00000100:00100000:0.0:1789672689.271200:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789672689.271208:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004c8b9e54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876607738317312:12345-0@lo:38: 00000100:00100000:0.0:1789672689.271315:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004c8b9e54 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876607738317312:12345-0@lo:38: Request processed in 106us (12867us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789672689.271322:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789672689.272265:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789672689.272278:0:3634:0:(import.c:65:import_set_state_nolock()) 000000000ba6f34e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789672689.272283:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789672689.272302:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009c808586 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876607738317312:0@lo:38: 20000000:01000000:0.0:1789672689.277534:0:6504:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789672689.277554:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789672689.277942:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb185c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:6488:x1876607738317568:12345-0@lo:253: Request processed in 9804us (10854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672689.277956:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 20000000:01000000:1.0:1789672689.278105:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789672689.278110:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789672689.278132:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964bfd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672689.278148:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000002580f3f/0x6c78c4f8c9964bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964bc5 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672689.278155:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964bfd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672689.278192:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000002580f3f/0x6c78c4f8c9964bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964bc5 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672689.278204:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000002580f3f/0x6c78c4f8c9964bcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964bc5 expref: 11 pid: 6504 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672689.278218:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058b9f1d2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876607738317696:0@lo:104: 00000100:00100000:1.0:1789672689.278255:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672689.278298:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067f58491 going to sleep for 11 seconds 00000100:00100000:0.0:1789672689.278394:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738317696 00000100:00100000:0.0:1789672689.278403:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738317696 00000100:00100000:0.0:1789672689.278450:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789672689.278458:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000410cf812 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6528:x1876607738317696:12345-0@lo:104: 00010000:00010000:0.0:1789672689.278469:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: 000000008970bfbf/0x6c78c4f8c9964bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964bcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672689.278513:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789672689.278518:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000410cf812 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6528:x1876607738317696:12345-0@lo:104: Request processed in 62us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672689.278524:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789672689.278605:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672689.278611:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 000000008970bfbf/0x6c78c4f8c9964bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964bcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.278619:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008970bfbf already unused, calling callback (00000000b39744ea) 10000000:00010000:2.0:1789672689.278622:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 000000008970bfbf/0x6c78c4f8c9964bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964bcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.278629:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 000000008970bfbf/0x6c78c4f8c9964bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964bcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672689.278635:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 000000008970bfbf/0x6c78c4f8c9964bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964bcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672689.278641:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789672689.278711:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 000000008970bfbf/0x6c78c4f8c9964bc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964bcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.278719:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672689.278735:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 000000008970bfbf/0x6c78c4f8c9964bc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964bcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.278758:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 000000008970bfbf/0x6c78c4f8c9964bc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964bcc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672689.278773:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672689.278775:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672689.278776:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672689.278890:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672689.278900:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039f336e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738317824:0@lo:103: 00000100:00100000:2.0:1789672689.278930:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672689.279232:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738317824 00000100:00100000:3.0:1789672689.279239:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738317824 00010000:00010000:3.0:1789672689.279258:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000002580f3f/0x6c78c4f8c9964bcc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964bc5 expref: 12 pid: 6504 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672689.279283:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789672689.279290:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a58e5c75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:3635:x1876607738317824:12345-0@lo:103: 00010000:00010000:3.0:1789672689.279300:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672689.279305:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000002580f3f/0x6c78c4f8c9964bcc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964bc5 expref: 12 pid: 6504 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672689.279314:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000002580f3f/0x6c78c4f8c9964bcc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964bc5 expref: 12 pid: 6504 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672689.279329:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964bfd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672689.279337:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964bfd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789672689.279362:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001252980s 00010000:00010000:3.0:1789672689.279366:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964bfd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672689.279373:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964bfd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672689.279378:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964bfd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672689.279384:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964bfd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672689.279389:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000029ebfd4 already unused, calling callback (00000000f7a32c66) 00010000:00010000:3.0:1789672689.279392:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964bfd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672689.279399:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964bfd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672689.279407:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964bfd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672689.279417:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672689.279455:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a58e5c75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:3635:x1876607738317824:12345-0@lo:103: Request processed in 166us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672689.279462:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789672689.279851:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039f336e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738317824:0@lo:103: 00000100:00100000:2.0:1789672689.279994:0:6488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009636d98f pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6488:1876607738317568:0@lo:253: 10000000:01000000:2.0:1789672689.280006:0:6488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789672689.280010:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789672689.280011:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789672689.280013:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672689.280014:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672689.280015:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672689.280016:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672689.280017:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789672689.280019:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789672689.280020:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789672689.280021:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789672689.280022:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672689.280024:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789672689.280033:0:6488:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789672689.280969:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000002580f3f/0x6c78c4f8c9964bcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964bc5 expref: 11 pid: 6504 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672689.280987:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058b9f1d2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876607738317696:0@lo:104: 00010000:00010000:1.0:1789672689.281002:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964bfd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672689.281010:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964bfd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672689.281033:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964bfd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672689.281039:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964bfd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1789672689.295609:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1789672689.299133:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789672689.299443:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1789672689.299618:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789672689.304296:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1789672689.304563:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789672689.310881:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1789672689.311062:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789672689.311268:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1789672689.311431:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789672689.311652:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1789672689.311865:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1789672689.337082:0:6488:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789672689.352105:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789672689.353187:0:6544:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789672689.353194:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789672689.357267:0:6545:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:1.0:1789672689.365981:0:6545:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789672689.374613:0:6545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789672689.374728:0:6545:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789672689.374733:0:6545:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1789672689.375562:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789672689.375747:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789672689.376195:0:6488:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789672689.376202:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789672689.376335:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789672689.385470:0:6488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789672689.387620:0:6488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789672689.392916:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789672689.393323:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789672689.393567:0:6488:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1789672689.395304:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789672689.395446:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789672689.395609:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789672689.395790:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789672689.395939:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789672689.396401:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789672689.396566:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789672689.397479:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789672689.397632:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789672689.397942:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789672689.398110:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789672689.398267:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789672689.398392:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789672689.398525:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789672689.398771:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789672689.398939:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789672689.399220:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789672689.399387:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789672689.399527:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789672689.399704:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789672689.399857:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789672689.400031:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789672689.400170:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789672689.400308:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789672689.400445:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789672689.400618:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789672689.400778:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789672689.403492:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789672689.404124:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789672689.404314:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789672689.404466:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789672689.404612:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789672689.405219:0:6488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1789672689.416025:0:6488:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789672689.416070:0:6488:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac6d81c6f988 00100000:10000000:0.0:1789672689.416079:0:6488:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789672689.417482:0:6488:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789672689.417500:0:6488:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789672689.417526:0:6488:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789672689.417549:0:6488:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789672689.418755:0:6488:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789672689.418962:0:6488:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789672689.859788:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672690.889026:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672691.909956:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672692.931818:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672693.957589:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789672694.162054:0:6789:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789672694.600949:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789672694.600960:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789672694.600963:0:8:0:(import.c:65:import_set_state_nolock()) 000000000ba6f34e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789672694.600983:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000ba6f34e using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789672694.601003:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000393176ce x1876607738318080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789672694.601047:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000393176ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876607738318080:0@lo:38: 00000100:00100000:3.0:1789672694.601159:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672694.602631:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010633d96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738317952:0@lo:400: 00000100:00100000:0.0:1789672694.602708:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672694.602816:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738318080 00000100:00100000:0.0:1789672694.602825:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738318080 00000100:00100000:0.0:1789672694.602858:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789672694.602877:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e065a485 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1876607738318080:12345-0@lo:38: 00010000:00080000:0.0:1789672694.602907:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:0.0:1789672694.602955:0:6514:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6c78c4f8c9964c04 00000004:00100000:0.0:1789672694.603035:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789672694.603188:0:6514:0:(import.c:65:import_set_state_nolock()) 000000006d9a10cb : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789672694.603246:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e065a485 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876607738318080:12345-0@lo:38: Request processed in 382us (2087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672694.603253:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789672694.603562:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738317952 00000100:00100000:3.0:1789672694.603571:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738317952 00000100:00100000:3.0:1789672694.603623:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789672694.603631:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000050f7e96f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+11:3637:x1876607738317952:12345-0@lo:400: 00000100:00100000:3.0:1789672694.603715:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000050f7e96f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+11:3637:x1876607738317952:12345-0@lo:400: Request processed in 85us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672694.603722:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789672694.603809:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000393176ce x1876607738318080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789672704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789672694.603826:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789672694.603834:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789672694.603838:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789672694.603840:0:3634:0:(import.c:65:import_set_state_nolock()) 000000000ba6f34e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789672694.603845:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000393176ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876607738318080:0@lo:38: 00000100:00100000:3.0:1789672694.603887:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010633d96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738317952:0@lo:400: 00010000:00010000:3.0:1789672694.982181:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789672695.330788:0:6841:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789672695.330979:0:6841:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789672696.012510:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789672696.644078:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789672696.644088:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfc44f3d800 from 3 10000000:01000000:0.0:1789672696.644094:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789672696.644171:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 000000005625ca95/0x6c78c4f8c9964c0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.644186:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 000000005625ca95/0x6c78c4f8c9964c0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.644199:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 000000005625ca95/0x6c78c4f8c9964c0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672696.644226:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f345d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738318208:0@lo:101: 00000100:00100000:0.0:1789672696.644310:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672696.644406:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f30788c8 going to sleep for 11 seconds 00000100:00100000:1.0:1789672696.645126:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738318208 00000100:00100000:1.0:1789672696.645146:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738318208 00000100:00100000:1.0:1789672696.645212:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789672696.645221:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009353aec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+11:6509:x1876607738318208:12345-0@lo:101: 00010000:00010000:1.0:1789672696.645238:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672696.645258:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e314c231/0x6c78c4f8c9964c12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964c0b expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672696.645286:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e314c231/0x6c78c4f8c9964c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964c0b expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672696.645296:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e314c231/0x6c78c4f8c9964c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964c0b expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672696.645306:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e314c231, rc 0) 00000100:00100000:1.0:1789672696.645382:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009353aec6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:6509:x1876607738318208:12345-0@lo:101: Request processed in 162us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672696.645413:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789672696.645723:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f345d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738318208:0@lo:101: 00010000:00010000:0.0:1789672696.645744:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 000000005625ca95/0x6c78c4f8c9964c0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964c12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672696.645753:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 000000005625ca95/0x6c78c4f8c9964c0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964c12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672696.645811:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f345d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738318336:0@lo:256: 00000100:00100000:0.0:1789672696.645847:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672696.645881:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f30788c8 going to sleep for 11 seconds 00000100:00100000:1.0:1789672696.646113:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738318336 00000100:00100000:1.0:1789672696.646119:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738318336 00000100:00100000:1.0:1789672696.646166:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789672696.646173:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000085b0d6cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:6509:x1876607738318336:12345-0@lo:256: 20000000:01000000:1.0:1789672696.646189:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789672696.646207:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789672696.646210:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789672696.646309:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000085b0d6cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:6509:x1876607738318336:12345-0@lo:256: Request processed in 137us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672696.646316:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789672696.646559:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f345d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738318336:0@lo:256: 10000000:01000000:2.0:1789672696.646619:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789672696.646627:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 000000005625ca95/0x6c78c4f8c9964c0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964c12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672696.646645:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 000000005625ca95/0x6c78c4f8c9964c0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964c12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672697.027996:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672698.058637:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789672698.654153:0:6943:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789672698.654378:0:6943:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789672699.077575:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672699.717103:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789672699.717147:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009636d98f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738318464:0@lo:400: 00000100:00100000:2.0:1789672699.717253:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672699.717322:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039f336e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738318592:0@lo:400: 00000100:00100000:2.0:1789672699.717357:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672699.717402:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738318464 00000100:00100000:2.0:1789672699.717412:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738318464 00000100:00100000:2.0:1789672699.717475:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789672699.717484:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cc279e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:3637:x1876607738318464:12345-0@lo:400: 00000100:00100000:2.0:1789672699.717542:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cc279e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:3637:x1876607738318464:12345-0@lo:400: Request processed in 59us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672699.717550:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789672699.717593:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738318592 00000100:00100000:2.0:1789672699.717597:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738318592 00000100:00100000:2.0:1789672699.717624:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789672699.717630:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000052ebb2e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738318592:12345-0@lo:400: 00000100:00100000:2.0:1789672699.717701:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000052ebb2e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738318592:12345-0@lo:400: Request processed in 71us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672699.717708:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789672699.717747:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000039f336e6 x1876607738318592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672699.717764:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039f336e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738318592:0@lo:400: 00000100:00100000:2.0:1789672699.717790:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009636d98f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738318464:0@lo:400: 00010000:00010000:0.0:1789672700.101709:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672701.123859:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672702.147966:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672703.177468:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672704.196864:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672704.836038:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789672704.836074:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1dbd18c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738318848:0@lo:400: 00000100:00100000:0.0:1789672704.836186:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672704.836299:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738318848 00000100:00100000:0.0:1789672704.836338:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738318848 00000100:00100000:0.0:1789672704.836402:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789672704.836412:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035c7c7f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738318848:12345-0@lo:400: 00000100:00100000:0.0:1789672704.836487:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035c7c7f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738318848:12345-0@lo:400: Request processed in 77us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672704.836508:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789672704.836567:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f1dbd18c x1876607738318848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672704.836583:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1dbd18c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738318848:0@lo:400: 00000100:00100000:2.0:1789672704.836745:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cbfee54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738318720:0@lo:400: 00000100:00100000:2.0:1789672704.836793:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672704.836887:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738318720 00000100:00100000:0.0:1789672704.836892:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738318720 00000100:00100000:0.0:1789672704.836967:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789672704.836974:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009c4c7738 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:3636:x1876607738318720:12345-0@lo:400: 00000100:00100000:0.0:1789672704.837022:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009c4c7738 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:3636:x1876607738318720:12345-0@lo:400: Request processed in 49us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672704.837028:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789672704.837089:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cbfee54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738318720:0@lo:400: 00010000:00010000:0.0:1789672705.219936:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672706.244017:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672707.269924:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672708.295158:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672709.321155:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672709.960680:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789672709.960736:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009636d98f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738318976:0@lo:400: 00000100:00100000:2.0:1789672709.960844:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672709.960913:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039f336e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738319104:0@lo:400: 00000100:00100000:2.0:1789672709.960944:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672709.960991:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738318976 00000100:00100000:2.0:1789672709.961002:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738318976 00000100:00100000:2.0:1789672709.961067:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789672709.961077:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000432ddecf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:3637:x1876607738318976:12345-0@lo:400: 00000100:00100000:2.0:1789672709.961140:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000432ddecf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:3637:x1876607738318976:12345-0@lo:400: Request processed in 64us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672709.961148:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789672709.961187:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738319104 00000100:00100000:2.0:1789672709.961191:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738319104 00000100:00100000:2.0:1789672709.961220:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789672709.961226:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000426aec02 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738319104:12345-0@lo:400: 00000100:00100000:2.0:1789672709.961259:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000426aec02 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738319104:12345-0@lo:400: Request processed in 34us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672709.961266:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789672709.961313:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000039f336e6 x1876607738319104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672709.961333:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039f336e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738319104:0@lo:400: 00000100:00100000:2.0:1789672709.961362:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009636d98f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738318976:0@lo:400: 00010000:00010000:1.0:1789672710.342846:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672711.363969:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789672711.670931:0:7442:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789672711.670935:0:7442:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789672711.670937:0:7442:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789672711.671092:0:7442:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e1a838be 00000020:01000004:2.0:1789672711.671107:0:7442:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1789672711.671122:0:7442:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789672711.671143:0:7442:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000c8b75bed) 00000020:00000080:2.0:1789672711.671160:0:7442:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789672711.783127:0:7442:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1789672711.783215:0:7442:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1789672711.830079:0:7442:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789672711.830281:0:7442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789672711.830291:0:7442:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789672711.830303:0:7442:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c78c4f8c9964c20 00000020:01000004:2.0:1789672711.830309:0:7442:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789672711.831616:0:7442:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.150@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789672711.831624:0:7442:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789672711.831633:0:7442:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789672711.831681:0:7442:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789672711.831684:0:7442:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789672711.850523:0:7442:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789672711.850580:0:7442:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.150@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1789672711.850585:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789672711.850587:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789672711.850588:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672711.850590:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672711.850592:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672711.850593:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672711.850595:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789672711.850596:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789672711.850598:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789672711.850599:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672711.850601:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789672711.850614:0:7442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1789672711.850617:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789672711.850619:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789672711.850620:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672711.850621:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672711.850622:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672711.850623:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672711.850624:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789672711.850625:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789672711.850626:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789672711.850632:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672711.850633:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789672711.850684:0:7442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789672711.850705:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009636d98f pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738319232:0@lo:253: 00000100:00100000:2.0:1789672711.850793:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672711.850855:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000058882fd2 going to sleep for 11 seconds 00000100:00100000:0.0:1789672711.851274:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738319232 00000100:00100000:0.0:1789672711.851284:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738319232 00000100:00100000:0.0:1789672711.851352:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789672711.851361:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006a78a0d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:7442:x1876607738319232:12345-0@lo:253: 20000000:01000000:0.0:1789672711.851426:0:6504:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789672711.851430:0:6504:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1789672711.851436:0:6504:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1789672711.851440:0:6504:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1789672711.851485:0:6504:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1789672711.851809:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789672711.852556:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789672711.852575:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789672711.852597:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789672711.852617:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789672711.852632:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789672711.852747:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1789672711.852754:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1789672711.852767:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1789672711.852772:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1789672711.852784:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1789672711.852789:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1789672711.852803:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789672711.852818:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789672711.853222:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1789672711.853232:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:0.0:1789672711.853248:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1789672711.853254:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789672711.853268:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1789672711.853275:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:0.0:1789672711.853288:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1789672711.853294:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789672711.853305:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789672711.853544:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789672711.853559:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789672711.853999:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1789672711.854010:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1789672711.854025:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789672711.854042:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789672711.854060:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1789672711.854067:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1789672711.854083:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789672711.854124:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789672711.854130:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1789672711.854154:0:6504:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789672711.854162:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1789672711.855118:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789672711.855511:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789672711.855535:0:6504:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.150@tcp for mdt 20000000:01000000:0.0:1789672711.855536:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:0.0:1789672711.855552:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789672711.855558:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789672711.855573:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789672711.855577:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:0.0:1789672711.855593:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789672711.855601:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1789672711.855787:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1789672711.855806:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1789672711.855853:0:6504:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1789672711.855862:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1789672711.856566:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1789672711.857011:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789672711.857033:0:6504:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.201.150@tcp for mdt 20000000:01000000:0.0:1789672711.857035:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:0.0:1789672711.857051:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789672711.857057:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789672711.857069:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789672711.857073:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:0.0:1789672711.857087:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789672711.857094:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1789672711.857104:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789672711.857118:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1789672711.857140:0:6504:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789672711.857143:0:6504:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789672711.857156:0:6504:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789672711.857209:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789672711.857211:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789672711.858854:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789672711.858910:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789672711.858922:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1789672711.859162:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789672711.859179:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789672711.859192:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1789672711.859202:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789672711.859205:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789672711.859775:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1789672711.859798:0:7451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1789672711.859813:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789672711.859981:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789672711.859998:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789672711.860024:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789672711.860035:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789672711.860037:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789672711.860554:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789672711.860574:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789672711.860589:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789672711.861652:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1789672711.861800:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1789672711.861819:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1789672711.861835:0:6504:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789672711.861838:0:6504:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789672711.861846:0:6504:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789672711.861855:0:6504:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789672711.862902:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1789672711.863002:0:6504:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789672711.876851:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789672711.877100:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964c27 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.877122:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002e81380d/0x6c78c4f8c9964b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964b55 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.877129:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964b71 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.877135:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000592a527b/0x6c78c4f8c9964be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964be1 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.877141:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964c27 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.877203:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000592a527b/0x6c78c4f8c9964be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964be1 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.877216:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000592a527b/0x6c78c4f8c9964be8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964be1 expref: 12 pid: 6504 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672711.877230:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039f336e6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1876607738319360:0@lo:104: 00000100:00100000:2.0:1789672711.877298:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789672711.877464:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964b71 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.877472:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964b71 expref: 12 pid: 6504 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672711.877481:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d991f36 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1876607738319488:0@lo:104: 00000100:00100000:2.0:1789672711.877504:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789672711.877596:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002e81380d/0x6c78c4f8c9964b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964b55 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.877613:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002e81380d/0x6c78c4f8c9964b5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964b55 expref: 12 pid: 6506 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672711.877623:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa61e78f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1876607738319616:0@lo:104: 00000100:00100000:2.0:1789672711.877645:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672711.878122:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738319360 00000100:00100000:1.0:1789672711.878133:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738319360 00000100:00100000:1.0:1789672711.878179:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738319488 00000100:00100000:1.0:1789672711.878183:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738319488 00000100:00100000:1.0:1789672711.878198:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789672711.878206:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b8470c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:6504:x1876607738319360:12345-0@lo:104: 00010000:00010000:1.0:1789672711.878219:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: 000000007eec6889/0x6c78c4f8c9964be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964be8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.878283:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789672711.878288:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b8470c76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:6504:x1876607738319360:12345-0@lo:104: Request processed in 84us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672711.878295:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789672711.878312:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789672711.878330:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bde6e970 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6504:x1876607738319488:12345-0@lo:104: 00010000:00010000:1.0:1789672711.878337:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: 00000000c0bb2983/0x6c78c4f8c9964b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964b78 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.878368:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789672711.878372:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bde6e970 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6504:x1876607738319488:12345-0@lo:104: Request processed in 56us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672711.878377:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789672711.878392:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789672711.878398:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 000000007eec6889/0x6c78c4f8c9964be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964be8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.878406:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007eec6889 already unused, calling callback (00000000b39744ea) 10000000:00010000:1.0:1789672711.878428:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 000000007eec6889/0x6c78c4f8c9964be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964be8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.878436:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 000000007eec6889/0x6c78c4f8c9964be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964be8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672711.878443:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 000000007eec6889/0x6c78c4f8c9964be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964be8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672711.878449:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672711.878477:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 000000007eec6889/0x6c78c4f8c9964be1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964be8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.878483:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672711.878500:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 000000007eec6889/0x6c78c4f8c9964be1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964be8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.878506:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 000000007eec6889/0x6c78c4f8c9964be1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964be8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.878520:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672711.878522:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 00000000c0bb2983/0x6c78c4f8c9964b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964b78 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.878528:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c0bb2983 already unused, calling callback (00000000b39744ea) 10000000:00010000:1.0:1789672711.878529:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 00000000c0bb2983/0x6c78c4f8c9964b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964b78 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.878535:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 00000000c0bb2983/0x6c78c4f8c9964b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964b78 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672711.878549:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 00000000c0bb2983/0x6c78c4f8c9964b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964b78 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672711.878554:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789672711.878754:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672711.878944:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 00000000c0bb2983/0x6c78c4f8c9964b71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964b78 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.878951:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672711.878977:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 00000000c0bb2983/0x6c78c4f8c9964b71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964b78 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.878984:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 00000000c0bb2983/0x6c78c4f8c9964b71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964b78 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.878993:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672711.878994:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672711.878995:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672711.879017:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058b9f1d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738319744:0@lo:103: 00000100:00100000:1.0:1789672711.879055:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672711.879097:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672711.879105:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003bfc48b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738319872:0@lo:103: 00000100:00100000:1.0:1789672711.879128:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672711.879161:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738319744 00000100:00100000:1.0:1789672711.879167:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738319744 00010000:00010000:1.0:1789672711.879187:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000592a527b/0x6c78c4f8c9964be8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964be1 expref: 13 pid: 6504 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672711.879208:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738319872 00000100:00100000:1.0:1789672711.879211:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738319872 00010000:00010000:1.0:1789672711.879230:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964b71 expref: 14 pid: 6504 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672711.879244:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789672711.879251:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009c848a56 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:3636:x1876607738319744:12345-0@lo:103: 00010000:00010000:1.0:1789672711.879264:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672711.879268:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000592a527b/0x6c78c4f8c9964be8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964be1 expref: 14 pid: 6504 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.879278:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000592a527b/0x6c78c4f8c9964be8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964be1 expref: 14 pid: 6504 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.879292:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672711.879437:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009c848a56 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:3636:x1876607738319744:12345-0@lo:103: Request processed in 187us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672711.879445:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789672711.879460:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789672711.879466:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bf8c8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+13:3638:x1876607738319872:12345-0@lo:103: 00010000:00010000:1.0:1789672711.879474:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672711.879477:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b78 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964b71 expref: 13 pid: 6504 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.879485:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964b71 expref: 13 pid: 6504 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.879495:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672711.879576:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bf8c8a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+13:3638:x1876607738319872:12345-0@lo:103: Request processed in 110us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672711.879583:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789672711.879771:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058b9f1d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738319744:0@lo:103: 00000100:00100000:0.0:1789672711.880024:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738319616 00000100:00100000:0.0:1789672711.880031:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738319616 00000100:00100000:0.0:1789672711.880057:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789672711.880063:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f17260c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6504:x1876607738319616:12345-0@lo:104: 00010000:00010000:0.0:1789672711.880072:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: 000000005f02944e/0x6c78c4f8c9964b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964b5c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.880114:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789672711.880119:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f17260c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6504:x1876607738319616:12345-0@lo:104: Request processed in 57us (2474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672711.880125:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789672711.880139:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672711.880142:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 000000005f02944e/0x6c78c4f8c9964b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964b5c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.880147:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005f02944e already unused, calling callback (00000000b39744ea) 10000000:00010000:0.0:1789672711.880149:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 000000005f02944e/0x6c78c4f8c9964b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964b5c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.880162:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 000000005f02944e/0x6c78c4f8c9964b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964b5c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672711.880166:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 000000005f02944e/0x6c78c4f8c9964b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964b5c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672711.880169:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789672711.880188:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 000000005f02944e/0x6c78c4f8c9964b55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964b5c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.880191:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672711.880198:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 000000005f02944e/0x6c78c4f8c9964b55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964b5c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.880202:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 000000005f02944e/0x6c78c4f8c9964b55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964b5c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.880212:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672711.880213:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672711.880214:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672711.880217:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672711.880224:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1dbd18c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738320000:0@lo:103: 00000100:00100000:0.0:1789672711.880256:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672711.880957:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738320000 00000100:00100000:1.0:1789672711.880964:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738320000 00010000:00010000:1.0:1789672711.880984:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002e81380d/0x6c78c4f8c9964b5c lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964b55 expref: 13 pid: 6506 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672711.881015:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789672711.881022:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7676f9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+13:3637:x1876607738320000:12345-0@lo:103: 00010000:00010000:1.0:1789672711.881031:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672711.881035:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002e81380d/0x6c78c4f8c9964b5c lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964b55 expref: 13 pid: 6506 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.881045:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002e81380d/0x6c78c4f8c9964b5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964b55 expref: 13 pid: 6506 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.881059:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964c27 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.881066:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964c27 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.881080:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964c27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.881086:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964c27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.881093:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964c27 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.881098:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964c27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.881111:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000081ceb849 already unused, calling callback (00000000f7a32c66) 00010000:00010000:1.0:1789672711.881115:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964c27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.881122:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964c27 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.881130:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964c27 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.881139:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672711.881177:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7676f9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+13:3637:x1876607738320000:12345-0@lo:103: Request processed in 157us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672711.881183:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789672711.881212:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1dbd18c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738320000:0@lo:103: 00000100:00100000:3.0:1789672711.881313:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003bfc48b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738319872:0@lo:103: 00000100:00100000:3.0:1789672711.881512:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b2ae1adb going to sleep for 11 seconds 00010000:00010000:3.0:1789672711.881529:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000592a527b/0x6c78c4f8c9964be8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964be1 expref: 12 pid: 6504 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672711.881543:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039f336e6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1876607738319360:0@lo:104: 00010000:00010000:3.0:1789672711.881552:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000097739a6d/0x6c78c4f8c9964b78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964b71 expref: 11 pid: 6504 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672711.882061:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d991f36 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1876607738319488:0@lo:104: 00010000:00010000:3.0:1789672711.882077:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002e81380d/0x6c78c4f8c9964b5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964b55 expref: 10 pid: 6506 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672711.882085:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa61e78f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1876607738319616:0@lo:104: 00010000:00010000:3.0:1789672711.882130:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964c27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672711.882140:0:6504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964c27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672711.882145:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964c27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672711.882164:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964c27 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789672711.882184:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789672711.886263:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006a78a0d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+9:7442:x1876607738319232:12345-0@lo:253: Request processed in 34895us (35462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672711.886279:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789672711.886412:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009636d98f pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738319232:0@lo:253: 10000000:01000000:2.0:1789672711.886439:0:7442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789672711.886442:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789672711.886445:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789672711.886457:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672711.886459:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1789672711.886460:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672711.886461:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672711.886463:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789672711.886464:0:7442:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789672711.886466:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672711.886468:0:7442:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789672711.886486:0:7442:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e1a838be from lustre-MDT0001 10000000:01000000:2.0:1789672711.886522:0:7442:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789672711.886525:0:7442:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789672711.886533:0:7442:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cfc499cb380 local copy 10000000:01000000:2.0:1789672711.886537:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789672711.886853:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.886866:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.886876:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672711.886894:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009636d98f pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738320128:0@lo:101: 00000100:00100000:2.0:1789672711.886931:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672711.887005:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025493818 going to sleep for 11 seconds 00000100:00100000:3.0:1789672711.887067:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738320128 00000100:00100000:3.0:1789672711.887074:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738320128 00000100:00100000:3.0:1789672711.887145:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789672711.887154:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a6c2752 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+9:7442:x1876607738320128:12345-0@lo:101: 00010000:00010000:3.0:1789672711.887166:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672711.887179:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007bec0251/0x6c78c4f8c9964c35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964c2e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672711.887201:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007bec0251/0x6c78c4f8c9964c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964c2e expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672711.887211:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007bec0251/0x6c78c4f8c9964c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964c2e expref: 10 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672711.887219:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007bec0251, rc 0) 00000100:00100000:3.0:1789672711.887262:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a6c2752 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+10:7442:x1876607738320128:12345-0@lo:101: Request processed in 110us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672711.887268:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789672711.887335:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009636d98f pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738320128:0@lo:101: 00010000:00010000:0.0:1789672711.887361:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964c2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6c78c4f8c9964c35 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.887371:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964c2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6c78c4f8c9964c35 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672711.887482:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c79cd024 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738320256:0@lo:501: 00000100:00100000:0.0:1789672711.887506:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672711.887587:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000005653f273 going to sleep for 11 seconds 00000100:00100000:2.0:1789672711.887924:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738320256 00000100:00100000:2.0:1789672711.887929:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738320256 00000100:00100000:2.0:1789672711.887954:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789672711.887960:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ad9354c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+10:7442:x1876607738320256:12345-0@lo:501: 00000100:00100000:2.0:1789672711.888060:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ad9354c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+10:7442:x1876607738320256:12345-0@lo:501: Request processed in 100us (553us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789672711.888067:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789672711.888183:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c79cd024 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738320256:0@lo:501: 10000000:01000000:0.0:1789672711.888196:0:7442:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789672711.888212:0:7442:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789672711.888216:0:7442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964c2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6c78c4f8c9964c35 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.888225:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964c2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6c78c4f8c9964c35 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.888231:0:7442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6c78c4f8c9964c35 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.888252:0:7442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789672711.888271:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfc7c498000 10000000:01000000:0.0:1789672711.888275:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789672711.888279:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cfc499cb380 10000000:01000000:0.0:1789672711.888281:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789672711.888284:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cfc499cb380 from 1 10000000:01000000:0.0:1789672711.888286:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789672711.888301:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000e090159b/0x6c78c4f8c9964c3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.888308:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000e090159b/0x6c78c4f8c9964c3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.888383:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000e090159b/0x6c78c4f8c9964c3c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672711.888395:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c79cd024 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738320384:0@lo:101: 00000100:00100000:0.0:1789672711.888428:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672711.888476:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c4e58ff going to sleep for 11 seconds 00000100:00100000:3.0:1789672711.888726:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738320384 00000100:00100000:3.0:1789672711.888732:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738320384 00000100:00100000:3.0:1789672711.888759:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789672711.888773:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d13edae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+10:7442:x1876607738320384:12345-0@lo:101: 00010000:00010000:3.0:1789672711.888781:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672711.888792:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000748c9098/0x6c78c4f8c9964c43 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964c3c expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672711.888811:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000748c9098/0x6c78c4f8c9964c43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964c3c expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672711.888820:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000748c9098/0x6c78c4f8c9964c43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964c3c expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672711.888826:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000748c9098, rc 0) 00000100:00100000:3.0:1789672711.888859:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d13edae3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+11:7442:x1876607738320384:12345-0@lo:101: Request processed in 87us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672711.888865:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789672711.888942:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c79cd024 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738320384:0@lo:101: 00010000:00010000:0.0:1789672711.888953:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000e090159b/0x6c78c4f8c9964c3c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964c43 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.888960:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000e090159b/0x6c78c4f8c9964c3c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964c43 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672711.888973:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789672711.889021:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000e090159b/0x6c78c4f8c9964c3c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964c43 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.889028:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000e090159b/0x6c78c4f8c9964c3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964c43 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672711.889037:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cfc7c498000 10000000:01000000:0.0:1789672711.889041:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789672711.889045:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cfc7c498000 from 1 10000000:01000000:0.0:1789672711.889047:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789672711.889061:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000514f8891/0x6c78c4f8c9964c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.889067:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000514f8891/0x6c78c4f8c9964c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.889079:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000514f8891/0x6c78c4f8c9964c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672711.889090:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c79cd024 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738320512:0@lo:101: 00000100:00100000:0.0:1789672711.889114:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672711.889132:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c4e58ff going to sleep for 11 seconds 00010000:00010000:2.0:1789672711.889194:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672711.889199:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x6c78c4f8c9964c35 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.889206:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000079168efa already unused, calling callback (00000000b39744ea) 10000000:00010000:2.0:1789672711.889209:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x6c78c4f8c9964c35 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.889216:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x6c78c4f8c9964c35 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672711.889222:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x6c78c4f8c9964c35 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672711.889227:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789672711.889243:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964c2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6c78c4f8c9964c35 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.889249:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672711.889280:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964c2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6c78c4f8c9964c35 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.889286:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964c2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6c78c4f8c9964c35 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.889300:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672711.889302:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672711.889303:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672711.890353:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738320512 00000100:00100000:2.0:1789672711.890363:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738320512 00000100:00100000:2.0:1789672711.890403:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789672711.890409:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000de628fa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+11:7442:x1876607738320512:12345-0@lo:101: 00010000:00010000:2.0:1789672711.890443:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672711.890457:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007eec6889/0x6c78c4f8c9964c51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964c4a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.890479:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007eec6889/0x6c78c4f8c9964c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964c4a expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.890488:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007eec6889/0x6c78c4f8c9964c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964c4a expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.890495:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007eec6889, rc 0) 00000100:00100000:2.0:1789672711.890541:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000de628fa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:7442:x1876607738320512:12345-0@lo:101: Request processed in 133us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672711.890547:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789672711.890845:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ff13799 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738320640:0@lo:103: 00000100:00100000:0.0:1789672711.890885:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672711.890950:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c79cd024 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738320512:0@lo:101: 00010000:00010000:0.0:1789672711.890967:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000514f8891/0x6c78c4f8c9964c4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964c51 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.890975:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000514f8891/0x6c78c4f8c9964c4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964c51 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672711.890992:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00000100:00100000:1.0:1789672711.891104:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738320640 00000100:00100000:1.0:1789672711.891109:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738320640 00000100:00100000:1.0:1789672711.891136:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789672711.891141:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a1b9761d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:3635:x1876607738320640:12345-0@lo:103: 00010000:00010000:1.0:1789672711.891150:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672711.891162:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007bec0251/0x6c78c4f8c9964c35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c9964c2e expref: 12 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672711.891177:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672711.891205:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a1b9761d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+11:3635:x1876607738320640:12345-0@lo:103: Request processed in 64us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672711.891212:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789672711.891246:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ff13799 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738320640:0@lo:103: 00010000:00010000:0.0:1789672711.896213:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000514f8891/0x6c78c4f8c9964c4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964c51 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.896235:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000514f8891/0x6c78c4f8c9964c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964c51 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672711.896246:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789672711.896257:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789672711.896266:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cfc7c498000 10000000:01000000:0.0:1789672711.896268:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789672711.896272:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789672711.896290:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789672711.896339:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000ee7f63cb/0x6c78c4f8c9964c58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.896347:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000ee7f63cb/0x6c78c4f8c9964c58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.896357:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000ee7f63cb/0x6c78c4f8c9964c58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672711.896382:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c79cd024 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738320768:0@lo:101: 00000100:00100000:0.0:1789672711.896461:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672711.896502:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c4e58ff going to sleep for 11 seconds 00000100:00100000:2.0:1789672711.896572:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738320768 00000100:00100000:2.0:1789672711.896581:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738320768 00000100:00100000:2.0:1789672711.896644:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789672711.896653:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000078a221af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+11:7442:x1876607738320768:12345-0@lo:101: 00010000:00010000:2.0:1789672711.896701:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672711.896714:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008970bfbf/0x6c78c4f8c9964c5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964c58 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.896737:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008970bfbf/0x6c78c4f8c9964c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964c58 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.896747:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008970bfbf/0x6c78c4f8c9964c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964c58 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672711.896754:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008970bfbf, rc 0) 00000100:00100000:2.0:1789672711.896798:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000078a221af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:7442:x1876607738320768:12345-0@lo:101: Request processed in 146us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672711.896804:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789672711.897102:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c79cd024 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738320768:0@lo:101: 00010000:00010000:0.0:1789672711.897117:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000ee7f63cb/0x6c78c4f8c9964c58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964c5f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672711.897125:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000ee7f63cb/0x6c78c4f8c9964c58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964c5f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672711.897232:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c79cd024 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738320896:0@lo:501: 00000100:00100000:0.0:1789672711.897261:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672711.897290:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c4e58ff going to sleep for 11 seconds 00000100:00100000:2.0:1789672711.897343:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738320896 00000100:00100000:2.0:1789672711.897348:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738320896 00000100:00100000:2.0:1789672711.897386:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789672711.897393:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c0f114ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:7442:x1876607738320896:12345-0@lo:501: 00000100:00100000:2.0:1789672711.897520:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c0f114ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:7442:x1876607738320896:12345-0@lo:501: Request processed in 129us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672711.897528:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789672711.897594:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c79cd024 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738320896:0@lo:501: 00000100:00100000:1.0:1789672711.897635:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058b9f1d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738321024:0@lo:503: 00000100:00100000:1.0:1789672711.897710:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672711.897729:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ea7bbcaf going to sleep for 11 seconds 00000100:00100000:2.0:1789672711.897785:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738321024 00000100:00100000:2.0:1789672711.897790:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738321024 00000100:00100000:2.0:1789672711.897823:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789672711.897829:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000029cc66b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:7442:x1876607738321024:12345-0@lo:503: 00000100:00100000:2.0:1789672711.897928:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000029cc66b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:7442:x1876607738321024:12345-0@lo:503: Request processed in 99us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672711.897934:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789672711.898180:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058b9f1d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738321024:0@lo:503: 00000040:00080000:1.0:1789672711.898467:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789672711.898546:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058b9f1d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738321152:0@lo:502: 00000100:00100000:1.0:1789672711.898601:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672711.898637:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ea7bbcaf going to sleep for 11 seconds 00000100:00100000:2.0:1789672711.898896:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738321152 00000100:00100000:2.0:1789672711.898902:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738321152 00000100:00100000:2.0:1789672711.898938:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789672711.898945:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000099280d2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:7442:x1876607738321152:12345-0@lo:502: 00000100:00100000:2.0:1789672711.899051:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000099280d2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:7442:x1876607738321152:12345-0@lo:502: Request processed in 107us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672711.899058:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789672711.899247:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058b9f1d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738321152:0@lo:502: 00000040:00080000:1.0:1789672711.899452:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789672711.899479:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1789672711.899493:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1789672711.899505:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1789672711.899516:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1789672711.899526:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1789672711.899538:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1789672711.899552:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1789672711.899578:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1789672711.899593:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1789672711.899617:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1789672711.899632:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1789672711.899643:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1789672711.899655:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1789672711.899704:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1789672711.899717:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1789672711.899730:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1789672711.899753:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1789672711.899766:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1789672711.899778:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1789672711.899789:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1789672711.899801:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1789672711.899814:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1789672711.899838:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058b9f1d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738321280:0@lo:502: 00000100:00100000:1.0:1789672711.899893:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672711.899926:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ea7bbcaf going to sleep for 11 seconds 00000100:00100000:2.0:1789672711.900328:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738321280 00000100:00100000:2.0:1789672711.900336:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738321280 00000100:00100000:2.0:1789672711.900380:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789672711.900387:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f49befda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:7442:x1876607738321280:12345-0@lo:502: 00000100:00100000:2.0:1789672711.900521:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f49befda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:7442:x1876607738321280:12345-0@lo:502: Request processed in 135us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672711.900528:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789672711.900980:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058b9f1d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738321280:0@lo:502: 00000040:00080000:1.0:1789672711.901053:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1789672711.901066:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1789672711.905553:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672711.905805:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672711.905808:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789672711.905816:0:7454:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789672711.905820:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789672711.905836:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000df8ad3d4) 00000020:00000080:0.0:1789672711.905859:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1789672711.905939:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789672711.906029:0:7454:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789672711.906037:0:7454:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c78c4f8c9964c6d 00000020:00000080:0.0:1789672711.906241:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789672711.906245:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672711.906248:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672711.906250:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789672711.906253:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672711.906257:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672711.906258:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789672711.906261:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789672711.906268:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000088697356) 00000020:00000080:0.0:1789672711.906278:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1789672711.906282:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789672711.906284:0:7454:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789672711.906286:0:7454:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789672711.906293:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789672711.906343:0:7454:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e1a838be from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789672711.906355:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000aa84a7a8) 00000020:00000080:0.0:1789672711.906363:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1789672711.906457:0:7454:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789672711.906463:0:7454:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c78c4f8c9964c82 00000020:00000080:0.0:1789672711.906552:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789672711.906840:0:7454:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789672711.906847:0:7454:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x6c78c4f8c9964c89 00080000:01000000:0.0:1789672711.906855:0:7454:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789672711.906858:0:7454:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c78c4f8c9964c90 00080000:10000000:0.0:1789672711.907308:0:7454:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1789672711.907448:0:7454:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1789672711.994401:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1789672711.994868:0:7454:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1789672711.999774:0:7454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789672712.000441:0:7454:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789672712.012847:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789672712.012868:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672712.012877:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672712.012879:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789672712.012884:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672712.012891:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672712.012893:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789672712.012896:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789672712.012901:0:7454:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:00000080:2.0:1789672712.012931:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789672712.012948:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000fc68cacd) 00000020:00000080:2.0:1789672712.012971:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1789672712.012976:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789672712.013181:0:7454:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789672712.013189:0:7454:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789672712.013196:0:7454:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c78c4f8c9964c9e 00010000:00080000:2.0:1789672712.013265:0:7454:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000010298307@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:2.0:1789672712.018770:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1789672712.026041:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789672712.026117:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789672712.026164:0:7454:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789672712.026184:0:7454:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c78c4f8c9964ca5 00000100:00080000:1.0:1789672712.026196:0:7454:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789672712.026208:0:7454:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000010298307 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789672712.026242:0:7454:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000058b9f1d2 x1876607738321408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789672712.026297:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058b9f1d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738321408:0@lo:38: 00000100:00100000:3.0:1789672712.026372:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672712.026526:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738321408 00000100:00100000:2.0:1789672712.026536:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738321408 00000100:00100000:2.0:1789672712.026584:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789672712.026591:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000010633d96 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876607738321408:12345-0@lo:38: 00010000:00080000:2.0:1789672712.026627:0:6517:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:2.0:1789672712.026685:0:6517:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c78c4f8c9964cac 00000004:00100000:2.0:1789672712.026698:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789672712.026703:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789672712.027059:0:7454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789672712.027136:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672712.027141:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672712.027143:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789672712.027146:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789672712.027149:0:7454:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789672712.027151:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789672712.027152:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789672712.027154:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789672712.027157:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672712.027165:0:7454:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789672712.027168:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672712.027173:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672712.027174:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789672712.027178:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789672712.027215:0:7454:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789672712.027230:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672712.027233:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672712.027235:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789672712.027237:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672712.027240:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672712.027241:0:7454:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789672712.027244:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789672712.027245:0:7454:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789672712.027266:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672712.027269:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672712.027270:0:7454:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789672712.027273:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:1.0:1789672712.027493:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1789672712.027522:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789672712.027539:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000ee7f63cb/0x6c78c4f8c9964c58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964c5f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672712.027551:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000ee7f63cb/0x6c78c4f8c9964c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964c5f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672712.027629:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfc7c498000 from 1 10000000:01000000:1.0:1789672712.027632:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789672712.027684:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000c320be82/0x6c78c4f8c9964cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672712.027693:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000c320be82/0x6c78c4f8c9964cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672712.027709:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000c320be82/0x6c78c4f8c9964cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672712.027728:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d0199639 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738321536:0@lo:101: 00000100:00100000:1.0:1789672712.027784:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672712.027808:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c37c658 going to sleep for 11 seconds 00000100:00100000:1.0:1789672712.027833:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738321536 00000100:00100000:1.0:1789672712.027838:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738321536 00000100:00100000:1.0:1789672712.027876:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789672712.027883:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000156adc18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+12:7442:x1876607738321536:12345-0@lo:101: 00010000:00010000:1.0:1789672712.027894:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672712.027905:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964cba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964cb3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672712.027923:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964cb3 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672712.027932:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964cb3 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672712.027939:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000029ebfd4, rc 0) 00000100:00100000:1.0:1789672712.027974:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000156adc18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+13:7442:x1876607738321536:12345-0@lo:101: Request processed in 93us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672712.027980:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789672712.028028:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d0199639 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738321536:0@lo:101: 00010000:00010000:1.0:1789672712.028041:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000c320be82/0x6c78c4f8c9964cb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964cba expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672712.028210:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000c320be82/0x6c78c4f8c9964cb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964cba expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672712.028718:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003782698b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738321664:0@lo:400: 00000100:00100000:0.0:1789672712.028758:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672712.029029:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738321664 00000100:00100000:2.0:1789672712.029035:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738321664 00000100:00100000:2.0:1789672712.029076:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789672712.029083:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d200ca6c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738321664:12345-0@lo:400: 00000100:00100000:2.0:1789672712.029130:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d200ca6c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738321664:12345-0@lo:400: Request processed in 48us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672712.029137:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789672712.029453:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000762db2e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738321792:0@lo:256: 00010000:00080000:1.0:1789672712.030514:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003782698b x1876607738321664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672712.030634:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003782698b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738321664:0@lo:400: 00000100:00100000:0.0:1789672712.033888:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672712.033926:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b9ec6880 going to sleep for 11 seconds 00000100:00100000:1.0:1789672712.034021:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738321792 00000100:00100000:1.0:1789672712.034031:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738321792 00000100:00100000:1.0:1789672712.034148:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789672712.034158:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f348ce7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+13:7442:x1876607738321792:12345-0@lo:256: 20000000:01000000:1.0:1789672712.034185:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789672712.034204:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789672712.034207:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789672712.034579:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f348ce7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+13:7442:x1876607738321792:12345-0@lo:256: Request processed in 422us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672712.034587:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1789672712.035218:0:6517:0:(import.c:65:import_set_state_nolock()) 00000000bb788178 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789672712.035284:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000010633d96 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1876607738321408:12345-0@lo:38: Request processed in 8692us (8912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672712.035293:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789672712.035458:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789672712.035468:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789672712.035476:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789672712.035481:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789672712.035483:0:3634:0:(import.c:65:import_set_state_nolock()) 0000000010298307 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789672712.035545:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058b9f1d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738321408:0@lo:38: 00000100:00100000:3.0:1789672712.035811:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000762db2e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738321792:0@lo:256: 10000000:01000000:3.0:1789672712.036530:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789672712.036544:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000c320be82/0x6c78c4f8c9964cb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964cba expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672712.036559:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000c320be82/0x6c78c4f8c9964cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964cba expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672712.036583:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc7c498000 from 1 10000000:01000000:3.0:1789672712.036587:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789672712.036623:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000ac0dec50/0x6c78c4f8c9964cc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672712.036631:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000ac0dec50/0x6c78c4f8c9964cc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672712.036640:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000ac0dec50/0x6c78c4f8c9964cc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672712.036726:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000393176ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738321920:0@lo:101: 00000100:00100000:3.0:1789672712.036784:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672712.036921:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000098f0dd6f going to sleep for 11 seconds 00000100:00100000:3.0:1789672712.037047:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789672712.037208:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738321920 00000100:00100000:0.0:1789672712.037217:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738321920 00000100:00100000:0.0:1789672712.037462:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789672712.037471:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000589338b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+13:7442:x1876607738321920:12345-0@lo:101: 00010000:00010000:0.0:1789672712.037485:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672712.037498:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091ba1884/0x6c78c4f8c9964cc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964cc1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672712.037521:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091ba1884/0x6c78c4f8c9964cc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964cc1 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672712.037531:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091ba1884/0x6c78c4f8c9964cc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964cc1 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672712.037539:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091ba1884, rc 0) 00000100:00100000:0.0:1789672712.037591:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000589338b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:7442:x1876607738321920:12345-0@lo:101: Request processed in 122us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672712.037597:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789672712.037691:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000393176ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738321920:0@lo:101: 00010000:00010000:2.0:1789672712.037706:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000ac0dec50/0x6c78c4f8c9964cc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964cc8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.037714:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000ac0dec50/0x6c78c4f8c9964cc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964cc8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672712.037838:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d694fbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738322176:0@lo:501: 00000100:00100000:2.0:1789672712.037867:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672712.037923:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d0199639 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738322048:0@lo:41: 00000100:00100000:3.0:1789672712.037954:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672712.037994:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738322048 00000100:00100000:3.0:1789672712.037999:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738322048 00000100:00100000:3.0:1789672712.038025:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789672712.038031:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c7b276c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1876607738322048:12345-0@lo:41: 00000004:00000024:3.0:1789672712.038068:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789672712.038125:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c7b276c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1876607738322048:12345-0@lo:41: Request processed in 94us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672712.038132:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789672712.038162:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d0199639 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738322048:0@lo:41: 00000100:00100000:2.0:1789672712.038955:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070df6eb1 going to sleep for 11 seconds 00000100:00100000:1.0:1789672712.038995:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738322176 00000100:00100000:1.0:1789672712.039002:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738322176 00000100:00100000:0.0:1789672712.039040:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789672712.039055:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000db0ae86f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:7442:x1876607738322176:12345-0@lo:501: 00000100:00100000:0.0:1789672712.039179:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000db0ae86f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:7442:x1876607738322176:12345-0@lo:501: Request processed in 132us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672712.039186:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789672712.039246:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d694fbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738322176:0@lo:501: 00000100:00100000:2.0:1789672712.039293:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d694fbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738322304:0@lo:503: 00000100:00100000:2.0:1789672712.039340:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672712.039569:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070df6eb1 going to sleep for 11 seconds 00000100:00100000:3.0:1789672712.039629:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738322304 00000100:00100000:3.0:1789672712.039639:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738322304 00000100:00100000:3.0:1789672712.039697:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789672712.039705:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009e93e43a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:7442:x1876607738322304:12345-0@lo:503: 00000040:00080000:3.0:1789672712.039741:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789672712.039781:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009e93e43a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:7442:x1876607738322304:12345-0@lo:503: Request processed in 78us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672712.039788:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789672712.039901:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d694fbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738322304:0@lo:503: 00000040:00080000:2.0:1789672712.040170:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789672712.040230:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1789672712.040298:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672712.041931:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1789672712.042173:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789672712.042205:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789672712.042256:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000ac0dec50/0x6c78c4f8c9964cc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964cc8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.042269:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000ac0dec50/0x6c78c4f8c9964cc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964cc8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672712.042355:0:7442:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789672712.042358:0:7442:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfc7c498000 10000000:01000000:2.0:1789672712.042362:0:7442:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfc7c498000 10000000:01000000:2.0:1789672712.042365:0:7442:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789672712.042371:0:7442:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfc7c498000 from 1 10000000:01000000:2.0:1789672712.042373:0:7442:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789672712.042411:0:7442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964ccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.042428:0:7442:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964ccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.042438:0:7442:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964ccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672712.042460:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d694fbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738322432:0@lo:101: 00000100:00100000:2.0:1789672712.042517:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672712.042559:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070df6eb1 going to sleep for 11 seconds 00000100:00100000:1.0:1789672712.042685:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738322432 00000100:00100000:1.0:1789672712.042693:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738322432 00000100:00100000:1.0:1789672712.042731:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789672712.042739:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009d6f891e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:7442:x1876607738322432:12345-0@lo:101: 00010000:00010000:1.0:1789672712.042753:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672712.042766:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000092fc3ed/0x6c78c4f8c9964cd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964ccf expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672712.042788:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000092fc3ed/0x6c78c4f8c9964cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964ccf expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672712.042810:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000092fc3ed/0x6c78c4f8c9964cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964ccf expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672712.042818:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000092fc3ed, rc 0) 00000100:00100000:1.0:1789672712.042859:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009d6f891e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:7442:x1876607738322432:12345-0@lo:101: Request processed in 121us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672712.042865:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789672712.043002:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d694fbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738322432:0@lo:101: 00010000:00010000:2.0:1789672712.043020:0:7442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964ccf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964cd6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.043035:0:7442:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964ccf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964cd6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672712.043169:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d694fbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738322560:0@lo:501: 00000100:00100000:2.0:1789672712.043191:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672712.043216:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070df6eb1 going to sleep for 11 seconds 00000100:00100000:0.0:1789672712.043259:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738322560 00000100:00100000:0.0:1789672712.043264:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738322560 00000100:00100000:0.0:1789672712.043327:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789672712.043334:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e17c1884 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:7442:x1876607738322560:12345-0@lo:501: 00000100:00100000:0.0:1789672712.043445:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e17c1884 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:7442:x1876607738322560:12345-0@lo:501: Request processed in 112us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672712.043452:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789672712.043514:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d694fbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738322560:0@lo:501: 00000100:00100000:2.0:1789672712.043543:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d694fbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738322688:0@lo:503: 00000100:00100000:2.0:1789672712.043579:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672712.043862:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070df6eb1 going to sleep for 11 seconds 00000100:00100000:1.0:1789672712.043950:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738322688 00000100:00100000:1.0:1789672712.043955:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738322688 00000100:00100000:1.0:1789672712.043975:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789672712.043979:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c49f1f39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:7442:x1876607738322688:12345-0@lo:503: 00000100:00100000:1.0:1789672712.044160:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c49f1f39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:7442:x1876607738322688:12345-0@lo:503: Request processed in 179us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672712.044167:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789672712.044261:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d694fbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738322688:0@lo:503: 00000040:00080000:2.0:1789672712.044682:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789672712.044764:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d694fbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738322816:0@lo:502: 00000100:00100000:2.0:1789672712.044808:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672712.044889:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070df6eb1 going to sleep for 11 seconds 00000100:00100000:0.0:1789672712.045087:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738322816 00000100:00100000:0.0:1789672712.045094:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738322816 00000100:00100000:3.0:1789672712.045267:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789672712.045277:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c888daa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:7442:x1876607738322816:12345-0@lo:502: 00000100:00100000:3.0:1789672712.045476:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c888daa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:7442:x1876607738322816:12345-0@lo:502: Request processed in 202us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672712.045484:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789672712.045608:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d694fbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738322816:0@lo:502: 00000040:00080000:2.0:1789672712.045856:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789672712.045888:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789672712.045903:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789672712.045914:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789672712.045940:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789672712.045956:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789672712.045968:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789672712.045980:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789672712.045992:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789672712.046005:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789672712.046031:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789672712.046044:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789672712.046071:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789672712.046085:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789672712.046097:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789672712.046109:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789672712.046122:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789672712.046134:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789672712.046145:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789672712.046155:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789672712.046180:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789672712.046193:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789672712.046203:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789672712.046214:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789672712.046225:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789672712.046235:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789672712.046245:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789672712.046257:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1789672712.046285:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d694fbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738322944:0@lo:502: 00000100:00100000:2.0:1789672712.046472:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672712.046501:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070df6eb1 going to sleep for 11 seconds 00000100:00100000:1.0:1789672712.046592:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738322944 00000100:00100000:1.0:1789672712.046600:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738322944 00000100:00100000:1.0:1789672712.046629:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789672712.046635:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cb8307 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:7442:x1876607738322944:12345-0@lo:502: 00000100:00100000:1.0:1789672712.046785:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cb8307 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:7442:x1876607738322944:12345-0@lo:502: Request processed in 150us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672712.046792:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789672712.046961:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d694fbf pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738322944:0@lo:502: 00000040:00080000:2.0:1789672712.047014:0:7442:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789672712.047025:0:7442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789672712.047999:0:7460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789672712.048025:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000bdeca8bc) 00000020:00000080:0.0:1789672712.048112:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789672712.048202:0:7460:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e1a838be from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789672712.048207:0:7460:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e1a838be from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789672712.048209:0:7460:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e1a838be 3 00010000:00080000:0.0:1789672712.048240:0:7460:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000042768c78@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:1.0:1789672712.050870:0:7460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1789672712.051238:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789672712.051299:0:7460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789672712.051384:0:7460:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x6c78c4f8c9964ce4 00000100:00080000:1.0:1789672712.051399:0:7460:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789672712.051410:0:7460:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000042768c78 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789672712.051471:0:7460:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000943b3ca7 x1876607738323072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789672712.051502:0:7460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789672712.051745:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000943b3ca7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876607738323072:0@lo:38: 00000100:00100000:0.0:1789672712.051813:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672712.051909:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738323072 00000100:00100000:1.0:1789672712.051916:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738323072 00000100:00100000:1.0:1789672712.051949:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789672712.051955:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000464d4a4b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876607738323072:12345-0@lo:38: 00010000:00080000:1.0:1789672712.051980:0:6512:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:1.0:1789672712.052009:0:6512:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x6c78c4f8c9964ceb 00000004:00100000:1.0:1789672712.052023:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789672712.052121:0:6512:0:(import.c:65:import_set_state_nolock()) 00000000a9cfb23d : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789672712.052170:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000464d4a4b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1876607738323072:12345-0@lo:38: Request processed in 214us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672712.052177:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1789672712.052441:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1789672712.052498:0:7442:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789672712.052527:0:7442:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789672712.052540:0:7442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964ccf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964cd6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672712.052550:0:7442:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 0000000079168efa/0x6c78c4f8c9964ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964cd6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789672712.052778:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789672712.052781:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789672712.052783:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789672712.052784:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789672712.052786:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789672712.052787:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789672712.052793:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789672712.052794:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789672712.052796:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789672712.052797:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789672712.052799:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789672712.052803:0:7442:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1789672712.052806:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789672712.052807:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789672712.052808:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789672712.052809:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789672712.052810:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789672712.052811:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789672712.052811:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789672712.052812:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789672712.052813:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789672712.052814:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789672712.052815:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789672712.052831:0:7442:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789672712.052842:0:7442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000093ae3f22 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738323200:0@lo:253: 00000100:00100000:1.0:1789672712.052882:0:7442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672712.052899:0:7442:0:(client.c:2716:ptlrpc_set_wait()) set 00000000148e9867 going to sleep for 11 seconds 00000100:00100000:0.0:1789672712.053028:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738323200 00000100:00100000:0.0:1789672712.053034:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738323200 00000100:00100000:0.0:1789672712.053152:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789672712.053160:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007dffe0d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:7442:x1876607738323200:12345-0@lo:253: 20000000:01000000:0.0:1789672712.053185:0:6504:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789672712.053494:0:6504:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1789672712.053633:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000943b3ca7 x1876607738323072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789672722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672712.053652:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789672712.053689:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789672712.053696:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789672712.053701:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789672712.053703:0:3634:0:(import.c:65:import_set_state_nolock()) 0000000042768c78 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789672712.053710:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000943b3ca7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876607738323072:0@lo:38: 40000000:00080000:3.0:1789672712.053849:0:7461:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000001:00100000:3.0:1789672712.062744:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789672712.062954:0:6504:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789672712.062974:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789672712.063187:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789672712.063193:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789672712.063219:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003c36e72b/0x6c78c4f8c9964cf2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063241:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e314c231/0x6c78c4f8c9964c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964c0b expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063263:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964cb3 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063268:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003c36e72b/0x6c78c4f8c9964cf2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063307:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964cb3 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063320:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964cba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964cb3 expref: 15 pid: 6507 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672712.063333:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d694fbf pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876607738323328:0@lo:104: 00000100:00100000:2.0:1789672712.063396:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789672712.063453:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e314c231/0x6c78c4f8c9964c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964c0b expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063460:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e314c231/0x6c78c4f8c9964c12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964c0b expref: 15 pid: 6504 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672712.063468:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876607738323456:0@lo:104: 00000100:00100000:2.0:1789672712.063488:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672712.063505:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee77ee0f going to sleep for 11 seconds 00000100:00100000:2.0:1789672712.063537:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738323328 00000100:00100000:2.0:1789672712.063546:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738323328 00000100:00100000:2.0:1789672712.063583:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738323456 00000100:00100000:2.0:1789672712.063586:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738323456 00000100:00100000:2.0:1789672712.063601:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789672712.063608:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e62e6cc9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:6528:x1876607738323328:12345-0@lo:104: 00010000:00010000:2.0:1789672712.063624:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: 00000000c320be82/0x6c78c4f8c9964cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964cba expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063700:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789672712.063706:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e62e6cc9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:6528:x1876607738323328:12345-0@lo:104: Request processed in 99us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672712.063713:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789672712.063730:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789672712.063735:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004382ade8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6528:x1876607738323456:12345-0@lo:104: 00010000:00010000:2.0:1789672712.063742:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: 000000005625ca95/0x6c78c4f8c9964c0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964c12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063773:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789672712.063778:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004382ade8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6528:x1876607738323456:12345-0@lo:104: Request processed in 44us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672712.063784:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789672712.063799:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789672712.063805:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 00000000c320be82/0x6c78c4f8c9964cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964cba expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063812:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c320be82 already unused, calling callback (00000000b39744ea) 10000000:00010000:2.0:1789672712.063816:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 00000000c320be82/0x6c78c4f8c9964cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964cba expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063822:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 00000000c320be82/0x6c78c4f8c9964cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964cba expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672712.063829:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 00000000c320be82/0x6c78c4f8c9964cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964cba expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672712.063840:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789672712.063873:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 00000000c320be82/0x6c78c4f8c9964cb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964cba expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063879:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672712.063896:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 00000000c320be82/0x6c78c4f8c9964cb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964cba expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063902:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 00000000c320be82/0x6c78c4f8c9964cb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964cba expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063925:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672712.063928:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 000000005625ca95/0x6c78c4f8c9964c0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964c12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063933:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005625ca95 already unused, calling callback (00000000b39744ea) 10000000:00010000:2.0:1789672712.063935:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 000000005625ca95/0x6c78c4f8c9964c0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964c12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063940:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 000000005625ca95/0x6c78c4f8c9964c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964c12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672712.063944:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 000000005625ca95/0x6c78c4f8c9964c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964c12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672712.063948:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789672712.063959:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 000000005625ca95/0x6c78c4f8c9964c0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964c12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063963:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672712.063986:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 000000005625ca95/0x6c78c4f8c9964c0b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964c12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.063992:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 000000005625ca95/0x6c78c4f8c9964c0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964c12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.064006:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672712.064008:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672712.064010:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672712.064017:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789672712.064026:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003782698b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738323584:0@lo:103: 00000100:00100000:1.0:1789672712.064242:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007dffe0d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:7442:x1876607738323200:12345-0@lo:253: Request processed in 11083us (11358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672712.064250:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789672712.064302:0:7442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000093ae3f22 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7442:1876607738323200:0@lo:253: 10000000:01000000:1.0:1789672712.064316:0:7442:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789672712.064319:0:7442:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789672712.064321:0:7442:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789672712.064323:0:7442:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789672712.064324:0:7442:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789672712.064326:0:7442:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789672712.064327:0:7442:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789672712.064329:0:7442:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789672712.064330:0:7442:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789672712.064338:0:7442:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789672712.064339:0:7442:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789672712.064340:0:7442:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789672712.064357:0:7442:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789672712.064602:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672712.064635:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789672712.064644:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ff13799 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738323712:0@lo:103: 00000100:00100000:2.0:1789672712.064693:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672712.064723:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738323584 00000100:00100000:2.0:1789672712.064730:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738323584 00010000:00010000:2.0:1789672712.064754:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964cba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964cb3 expref: 15 pid: 6507 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672712.064776:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738323712 00000100:00100000:2.0:1789672712.064779:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738323712 00010000:00010000:2.0:1789672712.064789:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e314c231/0x6c78c4f8c9964c12 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964c0b expref: 16 pid: 6504 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672712.064802:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789672712.064808:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009636d98f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:3637:x1876607738323584:12345-0@lo:103: 00010000:00010000:2.0:1789672712.064819:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672712.064823:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964cba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964cb3 expref: 16 pid: 6507 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.064842:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964cba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964cb3 expref: 16 pid: 6507 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.064858:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672712.064889:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009636d98f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:3637:x1876607738323584:12345-0@lo:103: Request processed in 82us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672712.064895:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789672712.064909:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789672712.064915:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c76b48c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:3636:x1876607738323712:12345-0@lo:103: 00010000:00010000:2.0:1789672712.064922:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672712.064925:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e314c231/0x6c78c4f8c9964c12 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964c0b expref: 15 pid: 6504 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.064932:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e314c231/0x6c78c4f8c9964c12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964c0b expref: 15 pid: 6504 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.064941:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003c36e72b/0x6c78c4f8c9964cf2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.064946:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c36e72b/0x6c78c4f8c9964cf2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789672712.064958:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001765949s 00010000:00010000:2.0:1789672712.064961:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003c36e72b/0x6c78c4f8c9964cf2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.064965:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003c36e72b/0x6c78c4f8c9964cf2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.064969:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003c36e72b/0x6c78c4f8c9964cf2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.064978:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003c36e72b/0x6c78c4f8c9964cf2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.064982:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003c36e72b already unused, calling callback (00000000f7a32c66) 00010000:00010000:2.0:1789672712.064985:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003c36e72b/0x6c78c4f8c9964cf2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.064990:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003c36e72b/0x6c78c4f8c9964cf2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.064999:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003c36e72b/0x6c78c4f8c9964cf2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.065016:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672712.065043:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c76b48c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:3636:x1876607738323712:12345-0@lo:103: Request processed in 129us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672712.065785:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789672712.065861:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ff13799 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738323712:0@lo:103: 00000100:00100000:2.0:1789672712.065887:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003782698b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738323584:0@lo:103: 00010000:00010000:2.0:1789672712.065910:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000029ebfd4/0x6c78c4f8c9964cba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964cb3 expref: 14 pid: 6507 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672712.065923:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d694fbf pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876607738323328:0@lo:104: 00010000:00010000:2.0:1789672712.065931:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e314c231/0x6c78c4f8c9964c12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964c0b expref: 13 pid: 6504 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672712.065938:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876607738323456:0@lo:104: 00010000:00010000:2.0:1789672712.065965:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003c36e72b/0x6c78c4f8c9964cf2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.065973:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003c36e72b/0x6c78c4f8c9964cf2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.065977:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003c36e72b/0x6c78c4f8c9964cf2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672712.065982:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003c36e72b/0x6c78c4f8c9964cf2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672712.066113:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1789672712.071540:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1789672712.073870:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789672712.074269:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1789672712.074476:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789672712.074786:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789672712.074956:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789672712.075629:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789672712.076037:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789672712.076316:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1789672712.076517:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789672712.076928:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1789672712.077187:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1789672712.078813:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1789672712.079134:0:7466:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1789672712.079192:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7466:1876607738323840:0@lo:700: 00000100:00100000:2.0:1789672712.079274:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1789672712.079355:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1789672712.079523:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf2d6b74 going to sleep for 11 seconds 00000100:00100000:2.0:1789672712.079710:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003782698b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876607738323968:0@lo:1000: 00000100:00100000:2.0:1789672712.079756:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672712.079779:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cb3a6ed0 going to sleep for 11 seconds 00000040:01000000:1.0:1789672712.080184:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789672712.080295:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789672712.080765:0:7442:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789672712.080773:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789672712.080910:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789672712.081935:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789672712.082558:0:7442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789672712.082590:0:7442:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789672712.082790:0:7442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789672712.083015:0:7442:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:2.0:1789672712.083607:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738323968 00000100:00100000:2.0:1789672712.083619:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738323968 00000100:00100000:2.0:1789672712.083694:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789672712.083704:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001ff13799 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876607738323968:12345-0@lo:1000: 00000100:00100000:2.0:1789672712.083823:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001ff13799 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876607738323968:12345-0@lo:1000: Request processed in 121us (4066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672712.083831:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789672712.083878:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003782698b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876607738323968:0@lo:1000: 00000040:01000000:2.0:1789672712.083912:0:7467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1789672712.083950:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003782698b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876607738324096:0@lo:700: 00000100:00100000:2.0:1789672712.083986:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672712.084017:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8f3c53c going to sleep for 11 seconds 00000020:00080000:0.0:1789672712.084106:0:7465:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789672712.084111:0:7465:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789672712.084285:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738324096 00000100:00100000:3.0:1789672712.084291:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738324096 00000100:00100000:3.0:1789672712.084362:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789672712.084369:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a58e5c75 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7467:x1876607738324096:12345-0@lo:700: 00000100:00100000:3.0:1789672712.084436:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a58e5c75 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7467:x1876607738324096:12345-0@lo:700: Request processed in 67us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672712.084442:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789672712.084499:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003782698b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876607738324096:0@lo:700: 00000100:00100000:0.0:1789672712.084541:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbd2423c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7467:1876607738324224:0@lo:900: 00000100:00100000:0.0:1789672712.084568:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672712.084585:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c73d376c going to sleep for 11 seconds 00100000:10000000:1.0:1789672712.084995:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000100:00100000:2.0:1789672712.085161:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738323840 00000100:00100000:2.0:1789672712.085168:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738323840 00000100:00100000:2.0:1789672712.085218:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789672712.085226:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002d694fbf pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1876607738323840:12345-0@lo:700: 00100000:10000000:1.0:1789672712.085497:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789672712.085637:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789672712.085848:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789672712.086006:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789672712.086262:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789672712.086487:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789672712.086620:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000100:00100000:2.0:1789672712.086736:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738324224 00000100:00100000:2.0:1789672712.086744:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738324224 00000100:00100000:2.0:1789672712.086796:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789672712.086805:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a43b9eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7467:x1876607738324224:12345-0@lo:900: 00000100:00100000:2.0:1789672712.086901:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a43b9eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7467:x1876607738324224:12345-0@lo:900: Request processed in 97us (2332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672712.086908:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789672712.087005:0:7467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cbd2423c x1876607738324224/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789672728 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672712.087021:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbd2423c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7467:1876607738324224:0@lo:900: 00000100:00100000:0.0:1789672712.087154:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbd2423c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876607738324352:0@lo:1000: 00000100:00100000:0.0:1789672712.087197:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672712.087238:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 000000003d57809d going to sleep for 11 seconds 00000100:00100000:2.0:1789672712.087364:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738324352 00000100:00100000:2.0:1789672712.087369:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738324352 00000100:00100000:2.0:1789672712.087409:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789672712.087424:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006525420d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876607738324352:12345-0@lo:1000: 00000100:00100000:2.0:1789672712.087490:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006525420d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876607738324352:12345-0@lo:1000: Request processed in 75us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672712.087497:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789672712.087571:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbd2423c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876607738324352:0@lo:1000: 00000004:00080000:0.0:1789672712.087620:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000c73d376c with version 0 00000020:00100000:0.0:1789672712.087635:0:7467:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789672712.087640:0:7467:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000cbd2423c x1876607738324608/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789672712.087754:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbd2423c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876607738324608:0@lo:1000: 00000100:00100000:0.0:1789672712.087777:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672712.087826:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc041d0c going to sleep for 11 seconds 00100000:10000000:1.0:1789672712.088152:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789672712.088308:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789672712.088499:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789672712.088637:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789672712.088807:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789672712.088952:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789672712.089368:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789672712.089520:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789672712.089945:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000100:00100000:2.0:1789672712.090226:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738324608 00000100:00100000:2.0:1789672712.090236:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738324608 00100000:10000000:1.0:1789672712.092245:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789672712.092461:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789672712.092617:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789672712.092805:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789672712.092937:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000100:00100000:2.0:1789672712.093192:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789672712.093205:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000fc5d9ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876607738324608:12345-0@lo:1000: 00100000:10000000:1.0:1789672712.093586:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789672712.093987:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789672712.094202:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789672712.094341:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789672712.096405:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789672712.096766:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789672712.096913:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789672712.102682:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789672712.102858:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789672712.103045:0:7442:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789672712.103421:0:7442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 40000000:02000000:2.0:1789672712.107448:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000001:00080000:3.0:1789672712.113443:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1789672712.113939:0:7442:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789672712.113974:0:7442:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffac6d81dc7988 00100000:10000000:1.0:1789672712.113982:0:7442:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789672712.116358:0:7442:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789672712.116406:0:7442:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789672712.116443:0:7442:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789672712.116477:0:7442:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000100:00100000:2.0:1789672712.122032:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002d694fbf pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1876607738323840:12345-0@lo:700: Request processed in 36802us (42753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672712.122133:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789672712.122191:0:7466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fae1a6bc x1876607738323840/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789672728 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672712.122208:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7466:1876607738323840:0@lo:700: 40000000:02000000:2.0:1789672712.122223:0:7466:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:0.0:1789672712.130801:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000fc5d9ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1876607738324608:12345-0@lo:1000: Request processed in 37595us (43017us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789672712.130824:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1789672712.131138:0:7467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789672712.131143:0:7467:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789672712.131161:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbd2423c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876607738324608:0@lo:1000: 00000100:00100000:0.0:1789672712.131262:0:7467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbd2423c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876607738324736:0@lo:1000: 00000100:00100000:0.0:1789672712.131303:0:7467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672712.131337:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738324736 00000100:00100000:0.0:1789672712.131344:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738324736 00000100:00100000:0.0:1789672712.131380:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789672712.131387:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000932deed3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1876607738324736:12345-0@lo:1000: 00000100:00100000:0.0:1789672712.131464:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000932deed3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1876607738324736:12345-0@lo:1000: Request processed in 77us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672712.131471:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789672712.131506:0:7467:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc041d0c going to sleep for 11 seconds 00000100:00100000:0.0:1789672712.131518:0:7467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbd2423c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1876607738324736:0@lo:1000: 00000040:00080000:0.0:1789672712.131532:0:7467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789672712.132736:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000f538eb8d with version 1 00000004:00080000:2.0:1789672712.141813:0:7457:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000b7f57aba version 1 rpc_version 1 00000020:00100000:2.0:1789672712.141850:0:7457:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789672712.141859:0:7457:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000fae1a6bc x1876607738324992/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789672712.141880:0:7457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7457:1876607738324992:0@lo:1000: 00000100:00100000:2.0:1789672712.141942:0:7457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672712.141987:0:7457:0:(client.c:2716:ptlrpc_set_wait()) set 000000003325e3ad going to sleep for 11 seconds 00000100:00100000:2.0:1789672712.142036:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738324992 00000100:00100000:2.0:1789672712.142043:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738324992 00000020:00000004:1.0:1789672712.143026:0:7442:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789672712.143346:0:7442:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1789672712.144301:0:7467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789672712.144380:0:7467:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1789672712.144736:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789672712.144746:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009636d98f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7457:x1876607738324992:12345-0@lo:1000: 00000001:00080000:1.0:1789672712.169710:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1789672712.169860:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009636d98f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7457:x1876607738324992:12345-0@lo:1000: Request processed in 25112us (27913us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789672712.169879:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1789672712.170080:0:7457:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789672712.170086:0:7457:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789672712.170104:0:7457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7457:1876607738324992:0@lo:1000: 00000040:00080000:0.0:1789672712.172212:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789672712.189252:0:7466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789672712.189347:0:7466:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789672712.189353:0:7466:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1789672712.389243:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672713.411839:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672714.436406:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672715.459799:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672716.483766:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672717.125111:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbd2423c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738325120:0@lo:400: 00000100:00100000:0.0:1789672717.125177:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672717.125221:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672717.125276:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1b9761d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738325504:0@lo:400: 00000100:00100000:0.0:1789672717.125340:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672717.125386:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062100797 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738325248:0@lo:400: 00000100:00100000:0.0:1789672717.125424:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672717.125449:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672717.125455:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7676f9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738325376:0@lo:400: 00000100:00100000:0.0:1789672717.125551:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672717.125582:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738325120 00000100:00100000:0.0:1789672717.125589:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738325120 00000100:00100000:0.0:1789672717.125630:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789672717.125636:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000776c67ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+13:3636:x1876607738325120:12345-0@lo:400: 00000100:00100000:0.0:1789672717.125706:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000776c67ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+13:3636:x1876607738325120:12345-0@lo:400: Request processed in 69us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672717.125713:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789672717.125759:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738325504 00000100:00100000:0.0:1789672717.125762:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738325504 00000100:00100000:0.0:1789672717.125931:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738325248 00000100:00100000:0.0:1789672717.125934:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738325248 00000100:00100000:0.0:1789672717.125951:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789672717.125956:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000762db2e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738325504:12345-0@lo:400: 00000100:00100000:0.0:1789672717.125987:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000762db2e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738325504:12345-0@lo:400: Request processed in 31us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672717.125992:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789672717.126011:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789672717.126015:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c79cd024 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738325248:12345-0@lo:400: 00000100:00100000:0.0:1789672717.126039:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c79cd024 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738325248:12345-0@lo:400: Request processed in 25us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672717.126043:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789672717.126058:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738325376 00000100:00100000:0.0:1789672717.126061:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738325376 00000100:00100000:0.0:1789672717.126082:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789672717.126086:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f1dbd18c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738325376:12345-0@lo:400: 00000100:00100000:0.0:1789672717.126111:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f1dbd18c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738325376:12345-0@lo:400: Request processed in 26us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672717.126115:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789672717.126149:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a1b9761d x1876607738325504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672717.126160:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1b9761d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738325504:0@lo:400: 00000100:00100000:0.0:1789672717.126166:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbd2423c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738325120:0@lo:400: 00000100:00100000:0.0:1789672717.126185:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7676f9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738325376:0@lo:400: 00010000:00080000:0.0:1789672717.126190:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000062100797 x1876607738325248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672717.126195:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062100797 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738325248:0@lo:400: 00000100:00100000:1.0:1789672717.128803:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672717.128988:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000093ae3f22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738325632:0@lo:41: 00000100:00100000:1.0:1789672717.129069:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672717.129102:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738325632 00000100:00100000:0.0:1789672717.129109:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738325632 00000100:00100000:0.0:1789672717.129149:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789672717.129156:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e56195dc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738325632:12345-0@lo:41: 00000004:00000024:0.0:1789672717.129190:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789672717.129962:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e56195dc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738325632:12345-0@lo:41: Request processed in 804us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672717.129970:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789672717.130020:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000093ae3f22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738325632:0@lo:41: 00010000:00010000:0.0:1789672717.522478:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789672717.859495:0:7712:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789672718.534345:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789672718.911262:0:7764:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789672718.911541:0:7764:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789672719.556874:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672720.579992:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789672721.223380:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789672721.223398:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfc7c498000 from 4 10000000:01000000:3.0:1789672721.223403:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789672721.223453:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000f5665726/0x6c78c4f8c9964cf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.223485:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000f5665726/0x6c78c4f8c9964cf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.223497:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000f5665726/0x6c78c4f8c9964cf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672721.223532:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de2c4772 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738325760:0@lo:101: 00000100:00100000:3.0:1789672721.223611:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672721.223920:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dee80fbc going to sleep for 11 seconds 00000100:00100000:1.0:1789672721.223984:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738325760 00000100:00100000:1.0:1789672721.223990:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738325760 00000100:00100000:1.0:1789672721.224033:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789672721.224039:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae2482dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+13:6509:x1876607738325760:12345-0@lo:101: 00010000:00010000:1.0:1789672721.224052:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672721.224064:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000062e9127a/0x6c78c4f8c9964d00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964cf9 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672721.224087:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000062e9127a/0x6c78c4f8c9964d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964cf9 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672721.224094:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000062e9127a/0x6c78c4f8c9964d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964cf9 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672721.224100:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000062e9127a, rc 0) 00000100:00100000:1.0:1789672721.224140:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae2482dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:6509:x1876607738325760:12345-0@lo:101: Request processed in 101us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672721.224154:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789672721.224167:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de2c4772 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738325760:0@lo:101: 00010000:00010000:3.0:1789672721.224193:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000f5665726/0x6c78c4f8c9964cf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d00 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.224204:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000f5665726/0x6c78c4f8c9964cf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964d00 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672721.224262:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de2c4772 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738325888:0@lo:256: 00000100:00100000:3.0:1789672721.224304:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672721.224365:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dee80fbc going to sleep for 11 seconds 00000100:00100000:2.0:1789672721.224852:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738325888 00000100:00100000:2.0:1789672721.224859:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738325888 00000100:00100000:2.0:1789672721.224927:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789672721.224935:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c66dc077 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:6509:x1876607738325888:12345-0@lo:256: 20000000:01000000:2.0:1789672721.224951:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789672721.224968:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789672721.224971:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789672721.225062:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c66dc077 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:6509:x1876607738325888:12345-0@lo:256: Request processed in 129us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672721.225070:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789672721.225101:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de2c4772 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738325888:0@lo:256: 10000000:01000000:2.0:1789672721.225152:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789672721.225159:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000f5665726/0x6c78c4f8c9964cf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d00 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672721.225168:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000f5665726/0x6c78c4f8c9964cf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d00 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672721.225177:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789672721.225196:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfc44f3d800 from 21 10000000:01000000:2.0:1789672721.225199:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789672721.225218:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 000000002e81380d/0x6c78c4f8c9964d07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672721.225224:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 000000002e81380d/0x6c78c4f8c9964d07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672721.225231:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 000000002e81380d/0x6c78c4f8c9964d07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672721.225244:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738326016:0@lo:101: 00000100:00100000:2.0:1789672721.225281:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672721.225475:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000083b95165 going to sleep for 11 seconds 00000100:00100000:2.0:1789672721.225491:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738326016 00000100:00100000:2.0:1789672721.225495:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738326016 00000100:00100000:2.0:1789672721.225529:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789672721.225534:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000799adb6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:6509:x1876607738326016:12345-0@lo:101: 00010000:00010000:2.0:1789672721.225541:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672721.225550:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964d0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964d07 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672721.225566:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d07 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672721.225574:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000081ceb849/0x6c78c4f8c9964d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d07 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672721.225581:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000081ceb849, rc 0) 00000100:00100000:2.0:1789672721.225608:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000799adb6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:6509:x1876607738326016:12345-0@lo:101: Request processed in 74us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672721.225620:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789672721.225648:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738326016:0@lo:101: 00010000:00010000:2.0:1789672721.225681:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 000000002e81380d/0x6c78c4f8c9964d07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d0e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672721.225689:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 000000002e81380d/0x6c78c4f8c9964d07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964d0e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672721.225744:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738326144:0@lo:501: 00000100:00100000:2.0:1789672721.225773:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672721.225787:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000083b95165 going to sleep for 11 seconds 00000100:00100000:2.0:1789672721.225797:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738326144 00000100:00100000:2.0:1789672721.225800:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738326144 00000100:00100000:2.0:1789672721.225815:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789672721.225819:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a26d7afa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:6509:x1876607738326144:12345-0@lo:501: 00000100:00100000:2.0:1789672721.225937:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a26d7afa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:6509:x1876607738326144:12345-0@lo:501: Request processed in 117us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672721.225944:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789672721.225969:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738326144:0@lo:501: 00000100:00100000:2.0:1789672721.225994:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738326272:0@lo:503: 00000100:00100000:2.0:1789672721.226031:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672721.226043:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000083b95165 going to sleep for 11 seconds 00000100:00100000:2.0:1789672721.226054:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738326272 00000100:00100000:2.0:1789672721.226057:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738326272 00000100:00100000:2.0:1789672721.226071:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789672721.226076:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005a7f6920 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:6509:x1876607738326272:12345-0@lo:503: 00000100:00100000:2.0:1789672721.226164:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005a7f6920 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:6509:x1876607738326272:12345-0@lo:503: Request processed in 87us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672721.226171:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789672721.228703:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738326272:0@lo:503: 00000100:00100000:2.0:1789672721.229372:0:7828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7828:1876607738326400:0@lo:502: 00000100:00100000:2.0:1789672721.229438:0:7828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672721.229517:0:7828:0:(client.c:2716:ptlrpc_set_wait()) set 0000000087846575 going to sleep for 11 seconds 00000100:00100000:3.0:1789672721.229605:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738326400 00000100:00100000:3.0:1789672721.229612:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738326400 00000100:00100000:3.0:1789672721.229719:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789672721.229729:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ece3186f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:7828:x1876607738326400:12345-0@lo:502: 00000100:00100000:3.0:1789672721.229863:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ece3186f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:7828:x1876607738326400:12345-0@lo:502: Request processed in 136us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672721.229872:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789672721.230004:0:7828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7828:1876607738326400:0@lo:502: 00000100:00100000:2.0:1789672721.230047:0:7828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7828:1876607738326528:0@lo:502: 00000100:00100000:2.0:1789672721.230079:0:7828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672721.230138:0:7828:0:(client.c:2716:ptlrpc_set_wait()) set 0000000087846575 going to sleep for 11 seconds 00000100:00100000:3.0:1789672721.230168:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738326528 00000100:00100000:3.0:1789672721.230172:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738326528 00000100:00100000:3.0:1789672721.230227:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789672721.230234:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084ac62f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:7828:x1876607738326528:12345-0@lo:502: 00000100:00100000:3.0:1789672721.230382:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084ac62f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:7828:x1876607738326528:12345-0@lo:502: Request processed in 149us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672721.230389:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789672721.230453:0:7828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7828:1876607738326528:0@lo:502: 00000040:00080000:2.0:1789672721.230473:0:7828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789672721.230753:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789672721.236961:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789672721.236982:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 000000002e81380d/0x6c78c4f8c9964d07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d0e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.237000:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 000000002e81380d/0x6c78c4f8c9964d07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d0e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672721.237011:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789672721.237015:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfc44f3d800 from 4 10000000:01000000:3.0:1789672721.237019:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789672721.237065:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 00000000eab87d87/0x6c78c4f8c9964d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.237073:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 00000000eab87d87/0x6c78c4f8c9964d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.237085:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 00000000eab87d87/0x6c78c4f8c9964d15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672721.237110:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa23431e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738326656:0@lo:101: 00000100:00100000:3.0:1789672721.237183:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672721.237228:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d8fe570 going to sleep for 11 seconds 00000100:00100000:1.0:1789672721.238457:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738326656 00000100:00100000:1.0:1789672721.238470:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738326656 00000100:00100000:1.0:1789672721.238531:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789672721.238540:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d227ec16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:6509:x1876607738326656:12345-0@lo:101: 00010000:00010000:1.0:1789672721.238555:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672721.238571:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b42b3657/0x6c78c4f8c9964d1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964d15 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672721.238603:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b42b3657/0x6c78c4f8c9964d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d15 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672721.238615:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b42b3657/0x6c78c4f8c9964d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d15 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672721.238625:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b42b3657, rc 0) 00000100:00100000:1.0:1789672721.238707:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d227ec16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738326656:12345-0@lo:101: Request processed in 168us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672721.238714:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789672721.238874:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa23431e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738326656:0@lo:101: 00010000:00010000:3.0:1789672721.238902:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 00000000eab87d87/0x6c78c4f8c9964d15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d1c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.238911:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 00000000eab87d87/0x6c78c4f8c9964d15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964d1c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672721.238984:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa23431e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738326784:0@lo:256: 00000100:00100000:3.0:1789672721.239021:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672721.239049:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d8fe570 going to sleep for 11 seconds 00000100:00100000:3.0:1789672721.239063:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738326784 00000100:00100000:3.0:1789672721.239067:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738326784 00000100:00100000:3.0:1789672721.239092:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789672721.239098:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009db6eac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738326784:12345-0@lo:256: 20000000:01000000:3.0:1789672721.239110:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789672721.239126:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789672721.239130:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789672721.239197:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009db6eac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738326784:12345-0@lo:256: Request processed in 99us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672721.239204:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789672721.239231:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa23431e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738326784:0@lo:256: 10000000:01000000:3.0:1789672721.239281:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789672721.239287:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 00000000eab87d87/0x6c78c4f8c9964d15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d1c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.239399:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 00000000eab87d87/0x6c78c4f8c9964d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d1c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672721.239418:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789672721.239421:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789672721.239423:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789672721.239441:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 0000000091884fba/0x6c78c4f8c9964d23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.239447:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 0000000091884fba/0x6c78c4f8c9964d23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.239454:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 0000000091884fba/0x6c78c4f8c9964d23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672721.239465:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa23431e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738326912:0@lo:101: 00000100:00100000:3.0:1789672721.239488:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672721.239577:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d8fe570 going to sleep for 11 seconds 00000100:00100000:3.0:1789672721.239591:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738326912 00000100:00100000:3.0:1789672721.239595:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738326912 00000100:00100000:3.0:1789672721.239615:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789672721.239621:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084a24fb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738326912:12345-0@lo:101: 00010000:00010000:3.0:1789672721.239628:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672721.239635:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ac13b65/0x6c78c4f8c9964d2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964d23 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.239649:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ac13b65/0x6c78c4f8c9964d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d23 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.239671:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ac13b65/0x6c78c4f8c9964d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d23 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.239689:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ac13b65, rc 0) 00000100:00100000:3.0:1789672721.239716:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084a24fb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738326912:12345-0@lo:101: Request processed in 95us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672721.239722:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789672721.239748:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa23431e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738326912:0@lo:101: 00010000:00010000:3.0:1789672721.239757:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 0000000091884fba/0x6c78c4f8c9964d23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.239763:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 0000000091884fba/0x6c78c4f8c9964d23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964d2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672721.239810:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa23431e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738327040:0@lo:501: 00000100:00100000:3.0:1789672721.239833:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672721.239861:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d8fe570 going to sleep for 11 seconds 00000100:00100000:3.0:1789672721.239873:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738327040 00000100:00100000:3.0:1789672721.242390:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738327040 00000100:00100000:3.0:1789672721.242478:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789672721.242487:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a04e8a1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738327040:12345-0@lo:501: 00000100:00100000:3.0:1789672721.243870:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a04e8a1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738327040:12345-0@lo:501: Request processed in 1379us (4030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672721.243883:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789672721.243930:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa23431e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738327040:0@lo:501: 00000100:00100000:3.0:1789672721.243977:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa23431e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738327168:0@lo:503: 00000100:00100000:3.0:1789672721.244032:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672721.244064:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d8fe570 going to sleep for 11 seconds 00000100:00100000:3.0:1789672721.244088:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738327168 00000100:00100000:3.0:1789672721.244096:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738327168 00000100:00100000:3.0:1789672721.244127:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789672721.244133:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008d3a94bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738327168:12345-0@lo:503: 00000100:00100000:3.0:1789672721.244202:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008d3a94bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738327168:12345-0@lo:503: Request processed in 69us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672721.244208:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789672721.244264:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa23431e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738327168:0@lo:503: 00000100:00100000:3.0:1789672721.246491:0:7830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa23431e pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7830:1876607738327296:0@lo:502: 00000100:00100000:3.0:1789672721.246684:0:7830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672721.246716:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738327296 00000100:00100000:3.0:1789672721.246723:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738327296 00000100:00100000:3.0:1789672721.246758:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789672721.246764:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000678f8f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:7830:x1876607738327296:12345-0@lo:502: 00000100:00100000:3.0:1789672721.246889:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000678f8f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:7830:x1876607738327296:12345-0@lo:502: Request processed in 124us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672721.246896:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789672721.246959:0:7830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf9806fc going to sleep for 11 seconds 00000100:00100000:3.0:1789672721.246978:0:7830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa23431e pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7830:1876607738327296:0@lo:502: 00000020:01000000:3.0:1789672721.247004:0:7830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789672721.247014:0:7830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672721.247017:0:7830:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789672721.247023:0:7830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789672721.247027:0:7830:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:00000080:3.0:1789672721.247049:0:7830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789672721.247063:0:7830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000e6ed78b5) 00000020:00000080:3.0:1789672721.247084:0:7830:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1789672721.247095:0:7830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789672721.247165:0:7830:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789672721.247170:0:7830:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789672721.247178:0:7830:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c78c4f8c9964d38 00010000:00080000:3.0:1789672721.247210:0:7830:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003ee2c6f9@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789672721.255124:0:7830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1789672721.259830:0:7830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789672721.259847:0:7830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789672721.259887:0:7830:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789672721.259912:0:7830:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c78c4f8c9964d3f 00000100:00080000:1.0:1789672721.259922:0:7830:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789672721.259933:0:7830:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000003ee2c6f9 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789672721.259969:0:7830:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fa5a8cd4 x1876607738327424/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789672721.259991:0:7830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1789672721.260043:0:7830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1789672721.260225:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa5a8cd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738327424:0@lo:38: 00000100:00100000:0.0:1789672721.260311:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672721.260366:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738327424 00000100:00100000:0.0:1789672721.260373:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738327424 00000100:00100000:0.0:1789672721.260414:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789672721.260421:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000062100797 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1876607738327424:12345-0@lo:38: 00010000:00080000:0.0:1789672721.260445:0:6518:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:0.0:1789672721.260479:0:6518:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c78c4f8c9964d46 00000004:00100000:0.0:1789672721.260492:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789672721.260498:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1789672721.260886:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098a1a646 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738327680:0@lo:400: 00000100:00100000:3.0:1789672721.260922:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672721.260990:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672721.260996:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa23431e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738327552:0@lo:400: 00000100:00100000:3.0:1789672721.261022:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672721.261049:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008fb101cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738327808:0@lo:400: 00000100:00100000:3.0:1789672721.261076:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672721.261110:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738327552 00000100:00100000:3.0:1789672721.261115:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738327552 00000100:00100000:3.0:1789672721.261146:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738327808 00000100:00100000:3.0:1789672721.261149:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738327808 00000100:00100000:3.0:1789672721.261163:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789672721.261169:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c17f27a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738327552:12345-0@lo:400: 00000100:00100000:3.0:1789672721.261233:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c17f27a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738327552:12345-0@lo:400: Request processed in 63us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672721.261240:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789672721.261265:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789672721.261271:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000d8b9c44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738327808:12345-0@lo:400: 00000100:00100000:3.0:1789672721.261302:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000d8b9c44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738327808:12345-0@lo:400: Request processed in 31us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672721.261308:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789672721.261332:0:6517:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789672721.261347:0:6517:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:3.0:1789672721.261376:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008fb101cb x1876607738327808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672721.261541:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008fb101cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738327808:0@lo:400: 00010000:00080000:3.0:1789672721.261690:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000fa23431e x1876607738327552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672721.261700:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa23431e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738327552:0@lo:400: 00000100:00080000:0.0:1789672721.261937:0:7833:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000b7676f9d x1876607738327936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672721.261947:0:7833:0:(client.c:2716:ptlrpc_set_wait()) set 0000000027c46a58 going to sleep for 0 seconds 00000020:01000000:1.0:1789672721.262048:0:7830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672721.262054:0:7830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672721.262057:0:7830:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789672721.262060:0:7830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672721.262064:0:7830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672721.262066:0:7830:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789672721.262068:0:7830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789672721.262070:0:7830:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789672721.262089:0:7830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000044e10135 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7830:1876607738328064:0@lo:502: 00000100:00100000:1.0:1789672721.262136:0:7830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672721.262172:0:7830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b6bc2eb9 going to sleep for 11 seconds 00000100:00100000:0.0:1789672721.262222:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738328064 00000100:00100000:0.0:1789672721.262227:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738328064 00000100:00100000:0.0:1789672721.262274:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789672721.262281:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000800bfea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:7830:x1876607738328064:12345-0@lo:502: 00000100:00100000:0.0:1789672721.262410:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000800bfea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:7830:x1876607738328064:12345-0@lo:502: Request processed in 129us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672721.262423:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789672721.262624:0:7830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000044e10135 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:7830:1876607738328064:0@lo:502: 00000020:01000000:1.0:1789672721.262648:0:7830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672721.262651:0:7830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672721.262653:0:7830:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789672721.262688:0:7830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1789672721.262858:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738327680 00000100:00100000:3.0:1789672721.262865:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738327680 00000100:00100000:1.0:1789672721.262978:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789672721.262985:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f9dca4b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738327680:12345-0@lo:400: 00000100:00100000:1.0:1789672721.263091:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f9dca4b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738327680:12345-0@lo:400: Request processed in 106us (2168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672721.263098:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789672721.263153:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098a1a646 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738327680:0@lo:400: 00000020:01000000:0.0:1789672721.263219:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789672721.263244:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789672721.263261:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 0000000091884fba/0x6c78c4f8c9964d23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672721.263272:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 0000000091884fba/0x6c78c4f8c9964d23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672721.263286:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789672721.263288:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cfc499cb380 from 1 10000000:01000000:0.0:1789672721.263290:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789672721.263315:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 000000003aa61582/0x6c78c4f8c9964d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672721.263322:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 000000003aa61582/0x6c78c4f8c9964d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672721.263330:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 000000003aa61582/0x6c78c4f8c9964d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672721.263343:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbd2423c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738328192:0@lo:101: 00000100:00100000:0.0:1789672721.263372:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672721.263516:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738328192 00000100:00100000:3.0:1789672721.263521:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738328192 00000100:00100000:3.0:1789672721.263557:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789672721.263564:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000abf49c62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738328192:12345-0@lo:101: 00010000:00010000:3.0:1789672721.263573:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672721.263586:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002d4f9611/0x6c78c4f8c9964d54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964d4d expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.263607:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d4f9611/0x6c78c4f8c9964d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d4d expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.263618:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002d4f9611/0x6c78c4f8c9964d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d4d expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672721.263626:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002d4f9611, rc 0) 00000100:00100000:3.0:1789672721.263651:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000abf49c62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738328192:12345-0@lo:101: Request processed in 89us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672721.263685:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789672721.263807:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1179d5d going to sleep for 11 seconds 00000100:00100000:0.0:1789672721.263820:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbd2423c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738328192:0@lo:101: 00010000:00010000:0.0:1789672721.263831:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 000000003aa61582/0x6c78c4f8c9964d4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672721.263839:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 000000003aa61582/0x6c78c4f8c9964d4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964d54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672721.263894:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbd2423c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738328320:0@lo:501: 00000100:00100000:0.0:1789672721.263921:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672721.263942:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1179d5d going to sleep for 11 seconds 00000100:00100000:1.0:1789672721.263985:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738328320 00000100:00100000:1.0:1789672721.263990:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738328320 00000100:00100000:1.0:1789672721.264024:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789672721.264030:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000acf36bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738328320:12345-0@lo:501: 00000100:00100000:1.0:1789672721.264112:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000acf36bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738328320:12345-0@lo:501: Request processed in 81us (189us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789672721.264120:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789672721.264218:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbd2423c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738328320:0@lo:501: 10000000:01000000:0.0:1789672721.264243:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789672721.264248:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: 000000003aa61582/0x6c78c4f8c9964d4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672721.264266:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: 000000003aa61582/0x6c78c4f8c9964d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789672721.276325:0:6518:0:(import.c:65:import_set_state_nolock()) 00000000abf35529 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789672721.276456:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000062100797 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1876607738327424:12345-0@lo:38: Request processed in 16030us (16140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672721.276471:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789672721.276831:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789672721.276845:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789672721.276854:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789672721.276859:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789672721.276864:0:3634:0:(import.c:65:import_set_state_nolock()) 000000003ee2c6f9 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789672721.276887:0:3634:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000027c46a58): req@00000000b7676f9d x1876607738327936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672721.276900:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa5a8cd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738327424:0@lo:38: 00000100:00100000:2.0:1789672721.276994:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672721.277005:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738328448:0@lo:41: 00000100:00100000:2.0:1789672721.277045:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672721.277085:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738328448 00000100:00100000:2.0:1789672721.277091:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738328448 00000100:00100000:2.0:1789672721.277122:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789672721.277128:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aa61e78f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1876607738328448:12345-0@lo:41: 00000004:00000024:2.0:1789672721.277152:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789672721.277182:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aa61e78f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1876607738328448:12345-0@lo:41: Request processed in 54us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672721.277188:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789672721.277213:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738328448:0@lo:41: 00000100:00100000:0.0:1789672721.277368:0:7833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672721.277468:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738327936 00000100:00100000:1.0:1789672721.277476:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738327936 00000100:00100000:1.0:1789672721.277506:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789672721.277512:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cbd2423c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7833:x1876607738327936:12345-0@lo:1000: 00000100:00100000:1.0:1789672721.277580:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cbd2423c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7833:x1876607738327936:12345-0@lo:1000: Request processed in 66us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672721.277587:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789672721.277633:0:7833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7676f9d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1876607738327936:0@lo:1000: 00000040:01000000:0.0:1789672721.277699:0:7833:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789672721.277736:0:7833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7676f9d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1876607738328576:0@lo:1000: 00000100:00100000:0.0:1789672721.277772:0:7833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672721.277787:0:7833:0:(client.c:2716:ptlrpc_set_wait()) set 0000000096e686c1 going to sleep for 11 seconds 00000100:00100000:1.0:1789672721.277842:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738328576 00000100:00100000:1.0:1789672721.277846:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738328576 00000100:00100000:1.0:1789672721.277879:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789672721.277885:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a1b9761d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7833:x1876607738328576:12345-0@lo:1000: 00000100:00100000:1.0:1789672721.277998:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a1b9761d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7833:x1876607738328576:12345-0@lo:1000: Request processed in 113us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672721.278007:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789672721.279414:0:7833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7676f9d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1876607738328576:0@lo:1000: 00000100:00100000:0.0:1789672721.279483:0:7833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7676f9d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1876607738328704:0@lo:700: 00000100:00100000:0.0:1789672721.279529:0:7833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672721.279598:0:7833:0:(client.c:2716:ptlrpc_set_wait()) set 0000000096e686c1 going to sleep for 11 seconds 00000100:00100000:2.0:1789672721.279892:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738328704 00000100:00100000:2.0:1789672721.279900:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738328704 00000100:00100000:2.0:1789672721.279955:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789672721.279961:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002cbfee54 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7833:x1876607738328704:12345-0@lo:700: 00000100:00100000:2.0:1789672721.280028:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002cbfee54 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7833:x1876607738328704:12345-0@lo:700: Request processed in 67us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672721.280035:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789672721.280306:0:7833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7676f9d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1876607738328704:0@lo:700: 00000100:00100000:1.0:1789672721.280525:0:7833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa5a8cd4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1876607738328832:0@lo:1000: 00000100:00100000:1.0:1789672721.280560:0:7833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672721.280588:0:7833:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028bf979a going to sleep for 11 seconds 00000100:00100000:2.0:1789672721.281288:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738328832 00000100:00100000:2.0:1789672721.281308:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738328832 00000100:00100000:2.0:1789672721.281359:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789672721.281366:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000044e10135 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7833:x1876607738328832:12345-0@lo:1000: 00000100:00100000:2.0:1789672721.281455:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000044e10135 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7833:x1876607738328832:12345-0@lo:1000: Request processed in 90us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672721.281463:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789672721.281481:0:7833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa5a8cd4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1876607738328832:0@lo:1000: 00000004:00080000:1.0:1789672721.281530:0:7833:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000ae4acacc with version 0 00000020:00100000:1.0:1789672721.281546:0:7833:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789672721.281553:0:7833:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000fa5a8cd4 x1876607738329088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789672721.281568:0:7833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa5a8cd4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1876607738329088:0@lo:1000: 00000100:00100000:1.0:1789672721.281596:0:7833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672721.281624:0:7833:0:(client.c:2716:ptlrpc_set_wait()) set 000000005343a0b8 going to sleep for 11 seconds 00000100:00100000:2.0:1789672721.281644:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738329088 00000100:00100000:2.0:1789672721.281648:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738329088 00000100:00100000:2.0:1789672721.281692:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789672721.281699:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009986fe2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7833:x1876607738329088:12345-0@lo:1000: 00000001:00080000:0.0:1789672721.301011:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1789672721.301025:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789672721.301203:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009986fe2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7833:x1876607738329088:12345-0@lo:1000: Request processed in 19500us (19602us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789672721.301216:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1789672721.301317:0:7833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789672721.301323:0:7833:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789672721.301341:0:7833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa5a8cd4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1876607738329088:0@lo:1000: 00000100:00100000:0.0:1789672721.301432:0:7833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035f345d6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1876607738329216:0@lo:1000: 00000100:00100000:0.0:1789672721.301467:0:7833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672721.301506:0:7833:0:(client.c:2716:ptlrpc_set_wait()) set 0000000096e686c1 going to sleep for 11 seconds 00000100:00100000:2.0:1789672721.301559:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738329216 00000100:00100000:2.0:1789672721.301567:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738329216 00000100:00100000:2.0:1789672721.301609:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789672721.301616:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000269e0dbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7833:x1876607738329216:12345-0@lo:1000: 00000100:00100000:2.0:1789672721.301872:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000269e0dbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7833:x1876607738329216:12345-0@lo:1000: Request processed in 256us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672721.301943:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789672721.302454:0:7833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035f345d6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7833:1876607738329216:0@lo:1000: 00000040:00080000:0.0:1789672721.302478:0:7833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789672721.302510:0:7833:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000b1179d5d with version 1 00000004:00080000:1.0:1789672721.302749:0:7831:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000042fd8a72 version 1 rpc_version 1 00000020:00100000:1.0:1789672721.302779:0:7831:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789672721.302786:0:7831:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b2b8b0c2 x1876607738329472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789672721.302806:0:7831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2b8b0c2 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7831:1876607738329472:0@lo:1000: 00000100:00100000:1.0:1789672721.302849:0:7831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672721.302960:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738329472 00000100:00100000:2.0:1789672721.302967:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738329472 00000100:00100000:2.0:1789672721.303008:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789672721.303016:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dab6cd5f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7831:x1876607738329472:12345-0@lo:1000: 00000100:00100000:1.0:1789672721.304060:0:7831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034fe3583 going to sleep for 11 seconds 00000040:00080000:0.0:1789672721.307158:0:7833:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789672721.307548:0:7833:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789672721.307554:0:7833:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:2.0:1789672721.324112:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1789672721.324565:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dab6cd5f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7831:x1876607738329472:12345-0@lo:1000: Request processed in 21545us (21711us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789672721.324582:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:2.0:1789672721.324735:0:7831:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789672721.324741:0:7831:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789672721.324761:0:7831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2b8b0c2 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7831:1876607738329472:0@lo:1000: 00010000:00010000:2.0:1789672721.611540:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789672722.090527:0:7871:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789672722.090984:0:7871:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789672722.246427:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672722.257136:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004cf5a73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738329600:0@lo:41: 00000100:00100000:3.0:1789672722.257244:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672722.257495:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738329600 00000100:00100000:0.0:1789672722.257504:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738329600 00000100:00100000:0.0:1789672722.257561:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789672722.257570:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000098a1a646 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738329600:12345-0@lo:41: 00000004:00000024:0.0:1789672722.257607:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789672722.257684:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000098a1a646 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738329600:12345-0@lo:41: Request processed in 115us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672722.257692:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789672722.262477:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004cf5a73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738329600:0@lo:41: 00010000:00010000:1.0:1789672722.627751:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789672723.266625:0:7919:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9069bb20 20000000:00000080:2.0:1789672723.266643:0:7919:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cfc7d2f6000 uarg=0000000000000000 20000000:01000000:2.0:1789672723.270533:0:7919:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789672723.270547:0:7919:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789672723.270553:0:7919:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789672723.270635:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789672723.270649:0:7919:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789672723.290840:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789672723.291093:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789672723.291126:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789672723.291143:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789672723.291159:0:7919:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789672723.291180:0:7919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c0bb2983/0x6c78c4f8c9964d5b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672723.291200:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006ee5bcbf/0x6c78c4f8c9964bda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964bd3 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672723.291208:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000091ba1884/0x6c78c4f8c9964cc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964cc1 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672723.291224:0:7919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c0bb2983/0x6c78c4f8c9964d5b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672723.291271:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000091ba1884/0x6c78c4f8c9964cc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964cc1 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672723.291285:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000091ba1884/0x6c78c4f8c9964cc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964cc1 expref: 17 pid: 6504 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672723.291299:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1876607738329728:0@lo:104: 00000100:00100000:2.0:1789672723.291387:0:7919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789672723.291457:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006ee5bcbf/0x6c78c4f8c9964bda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964bd3 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672723.291466:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006ee5bcbf/0x6c78c4f8c9964bda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964bd3 expref: 17 pid: 6506 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672723.291474:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d991f36 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1876607738329856:0@lo:104: 00000100:00100000:2.0:1789672723.291495:0:7919:0:(client.c:2716:ptlrpc_set_wait()) set 00000000180879e0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672723.293533:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789672723.293592:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672723.293635:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738329728 00000100:00100000:0.0:1789672723.293643:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738329728 00000100:00100000:0.0:1789672723.293699:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738329856 00000100:00100000:0.0:1789672723.293703:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738329856 00000100:00100000:0.0:1789672723.293734:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789672723.293742:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c4fb0884 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:7919:x1876607738329728:12345-0@lo:104: 00010000:00010000:0.0:1789672723.293760:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: 00000000ac0dec50/0x6c78c4f8c9964cc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964cc8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.293840:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789672723.293845:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c4fb0884 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:7919:x1876607738329728:12345-0@lo:104: Request processed in 105us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672723.293851:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789672723.293891:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789672723.293896:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000035f345d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:7919:x1876607738329856:12345-0@lo:104: 00010000:00010000:0.0:1789672723.293902:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: 000000004dcb6424/0x6c78c4f8c9964bd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964bda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.293932:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789672723.293936:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000035f345d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:7919:x1876607738329856:12345-0@lo:104: Request processed in 41us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672723.293941:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1789672723.293958:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789672723.293964:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 00000000ac0dec50/0x6c78c4f8c9964cc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964cc8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.293971:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ac0dec50 already unused, calling callback (00000000b39744ea) 10000000:00010000:0.0:1789672723.293975:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 00000000ac0dec50/0x6c78c4f8c9964cc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964cc8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.293982:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 00000000ac0dec50/0x6c78c4f8c9964cc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964cc8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672723.293998:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 00000000ac0dec50/0x6c78c4f8c9964cc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964cc8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672723.294003:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789672723.294039:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 00000000ac0dec50/0x6c78c4f8c9964cc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964cc8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294045:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672723.294063:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 00000000ac0dec50/0x6c78c4f8c9964cc1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964cc8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294069:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 00000000ac0dec50/0x6c78c4f8c9964cc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964cc8 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294082:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672723.294084:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: 000000004dcb6424/0x6c78c4f8c9964bd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964bda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294089:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004dcb6424 already unused, calling callback (00000000b39744ea) 10000000:00010000:0.0:1789672723.294091:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: 000000004dcb6424/0x6c78c4f8c9964bd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964bda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294097:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: 000000004dcb6424/0x6c78c4f8c9964bd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964bda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672723.294102:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: 000000004dcb6424/0x6c78c4f8c9964bd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964bda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672723.294106:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789672723.294123:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: 000000004dcb6424/0x6c78c4f8c9964bd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964bda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294128:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672723.294142:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: 000000004dcb6424/0x6c78c4f8c9964bd3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964bda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294147:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: 000000004dcb6424/0x6c78c4f8c9964bd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964bda expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294159:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672723.294160:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672723.294161:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672723.294167:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672723.294187:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eec03880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738329984:0@lo:103: 00000100:00100000:0.0:1789672723.294250:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672723.294289:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fae1a6bc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1876607738329728:0@lo:104: 00000100:00100000:3.0:1789672723.294302:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d991f36 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1876607738329856:0@lo:104: 00000100:00100000:0.0:1789672723.294309:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7676f9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738330112:0@lo:103: 00010000:00010000:3.0:1789672723.294326:0:7919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c0bb2983/0x6c78c4f8c9964d5b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672723.294337:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672723.294508:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738329984 00000100:00100000:0.0:1789672723.294513:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738329984 00010000:00010000:0.0:1789672723.294531:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000091ba1884/0x6c78c4f8c9964cc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964cc1 expref: 18 pid: 6504 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672723.294569:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738330112 00000100:00100000:0.0:1789672723.294572:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738330112 00010000:00010000:0.0:1789672723.294581:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006ee5bcbf/0x6c78c4f8c9964bda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964bd3 expref: 19 pid: 6506 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672723.294596:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789672723.294603:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002375a162 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:3638:x1876607738329984:12345-0@lo:103: 00000100:00100000:3.0:1789672723.294613:0:6498:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789672723.294622:0:6498:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789672723.294623:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672723.294630:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000091ba1884/0x6c78c4f8c9964cc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964cc1 expref: 19 pid: 6504 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294640:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000091ba1884/0x6c78c4f8c9964cc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964cc1 expref: 19 pid: 6504 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294654:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000091ba1884/0x6c78c4f8c9964cc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964cc1 expref: 19 pid: 6504 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294687:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672723.294720:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002375a162 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:3638:x1876607738329984:12345-0@lo:103: Request processed in 119us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672723.294727:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789672723.294742:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789672723.294746:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002eb3750a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:3635:x1876607738330112:12345-0@lo:103: 00010000:00010000:0.0:1789672723.294753:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672723.294755:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006ee5bcbf/0x6c78c4f8c9964bda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964bd3 expref: 17 pid: 6506 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294762:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006ee5bcbf/0x6c78c4f8c9964bda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964bd3 expref: 17 pid: 6506 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294770:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006ee5bcbf/0x6c78c4f8c9964bda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964bd3 expref: 17 pid: 6506 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294779:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c0bb2983/0x6c78c4f8c9964d5b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294786:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0bb2983/0x6c78c4f8c9964d5b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294802:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c0bb2983/0x6c78c4f8c9964d5b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294808:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c0bb2983/0x6c78c4f8c9964d5b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294814:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c0bb2983/0x6c78c4f8c9964d5b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294820:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c0bb2983/0x6c78c4f8c9964d5b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294825:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c0bb2983 already unused, calling callback (00000000f7a32c66) 00010000:00010000:0.0:1789672723.294828:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c0bb2983/0x6c78c4f8c9964d5b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294835:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c0bb2983/0x6c78c4f8c9964d5b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294855:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c0bb2983/0x6c78c4f8c9964d5b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.294863:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672723.294890:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002eb3750a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:3635:x1876607738330112:12345-0@lo:103: Request processed in 144us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672723.294896:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789672723.294923:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7676f9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738330112:0@lo:103: 00000100:00100000:0.0:1789672723.294944:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eec03880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738329984:0@lo:103: 00010000:00010000:3.0:1789672723.295081:0:7919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c0bb2983/0x6c78c4f8c9964d5b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672723.295090:0:7919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c0bb2983/0x6c78c4f8c9964d5b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672723.295097:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c0bb2983/0x6c78c4f8c9964d5b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672723.657488:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672724.677612:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672725.715272:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672726.339993:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f67163d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738330624:0@lo:400: 00000100:00100000:3.0:1789672726.340058:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672726.340107:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789672726.340113:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa23431e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738330240:0@lo:400: 00000100:00100000:3.0:1789672726.340153:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672726.340189:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b0ca3e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738330752:0@lo:400: 00000100:00100000:3.0:1789672726.340221:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672726.340248:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008fb101cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738330368:0@lo:400: 00000100:00100000:3.0:1789672726.340270:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672726.340288:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789672726.340293:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e61f476 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738330496:0@lo:400: 00000100:00100000:3.0:1789672726.340327:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672726.340361:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738330624 00000100:00100000:3.0:1789672726.340370:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738330624 00000100:00100000:3.0:1789672726.340418:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738330368 00000100:00100000:3.0:1789672726.340422:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738330368 00000100:00100000:3.0:1789672726.340438:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789672726.340446:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002aa591be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738330624:12345-0@lo:400: 00000100:00100000:3.0:1789672726.340498:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002aa591be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738330624:12345-0@lo:400: Request processed in 54us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672726.340505:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789672726.340521:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789672726.340527:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000de2c4772 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738330368:12345-0@lo:400: 00000100:00100000:3.0:1789672726.340556:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000de2c4772 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738330368:12345-0@lo:400: Request processed in 30us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672726.340561:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789672726.340578:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738330752 00000100:00100000:3.0:1789672726.340582:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738330752 00000100:00100000:3.0:1789672726.340605:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738330496 00000100:00100000:3.0:1789672726.340608:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738330496 00000100:00100000:3.0:1789672726.340621:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789672726.340626:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000051229227 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738330752:12345-0@lo:400: 00000100:00100000:3.0:1789672726.341230:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000051229227 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738330752:12345-0@lo:400: Request processed in 601us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672726.341239:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789672726.341256:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789672726.341262:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000393176ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738330496:12345-0@lo:400: 00000100:00100000:3.0:1789672726.341292:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000393176ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738330496:12345-0@lo:400: Request processed in 32us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672726.341359:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789672726.341415:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e61f476 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738330496:0@lo:400: 00010000:00080000:3.0:1789672726.341429:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008fb101cb x1876607738330368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672726.341439:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008fb101cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738330368:0@lo:400: 00000100:00100000:3.0:1789672726.341469:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b0ca3e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738330752:0@lo:400: 00010000:00080000:3.0:1789672726.341479:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f67163d1 x1876607738330624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672726.341488:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f67163d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738330624:0@lo:400: 00000100:00100000:1.0:1789672726.341583:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738330240 00000100:00100000:1.0:1789672726.341589:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738330240 00000100:00100000:1.0:1789672726.341630:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789672726.341637:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004315e5f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:3635:x1876607738330240:12345-0@lo:400: 00000100:00100000:1.0:1789672726.341708:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004315e5f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:3635:x1876607738330240:12345-0@lo:400: Request processed in 72us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672726.341714:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789672726.341748:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa23431e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738330240:0@lo:400: 00000100:00100000:0.0:1789672726.348155:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789672726.348202:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f6b5b4c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738330880:0@lo:41: 00000100:00100000:0.0:1789672726.348298:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672726.348385:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738330880 00000100:00100000:0.0:1789672726.348394:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738330880 00000100:00100000:0.0:1789672726.348447:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789672726.348456:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cfb30d88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738330880:12345-0@lo:41: 00000004:00000024:0.0:1789672726.348496:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789672726.348545:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cfb30d88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738330880:12345-0@lo:41: Request processed in 91us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672726.348553:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789672726.348603:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f6b5b4c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738330880:0@lo:41: 00010000:00010000:0.0:1789672726.725304:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672727.367698:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789672727.367734:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039f336e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738331008:0@lo:41: 00000100:00100000:2.0:1789672727.367815:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672727.367898:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738331008 00000100:00100000:2.0:1789672727.367906:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738331008 00000100:00100000:2.0:1789672727.367945:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789672727.367953:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000197cfd96 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738331008:12345-0@lo:41: 00000004:00000024:2.0:1789672727.367989:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1789672727.368036:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000197cfd96 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738331008:12345-0@lo:41: Request processed in 84us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672727.368043:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789672727.368115:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039f336e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738331008:0@lo:41: 10000000:01000000:2.0:1789672727.372889:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789672727.372896:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc7c498000 from 1 10000000:01000000:2.0:1789672727.372900:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789672727.372948:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: 000000006ee5bcbf/0x6c78c4f8c9964d62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672727.372961:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: 000000006ee5bcbf/0x6c78c4f8c9964d62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672727.372971:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: 000000006ee5bcbf/0x6c78c4f8c9964d62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672727.373000:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039f336e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738331136:0@lo:101: 00000100:00100000:2.0:1789672727.373071:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672727.373278:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 0000000083b95165 going to sleep for 11 seconds 00000100:00100000:0.0:1789672727.373422:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738331136 00000100:00100000:0.0:1789672727.373431:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738331136 00000100:00100000:0.0:1789672727.373523:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789672727.373531:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000034bc90c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738331136:12345-0@lo:101: 00010000:00010000:0.0:1789672727.373544:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672727.373558:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003448edca/0x6c78c4f8c9964d69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964d62 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672727.373581:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003448edca/0x6c78c4f8c9964d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d62 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672727.373591:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003448edca/0x6c78c4f8c9964d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d62 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672727.373599:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003448edca, rc 0) 00000100:00100000:0.0:1789672727.373751:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000034bc90c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738331136:12345-0@lo:101: Request processed in 126us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672727.373760:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789672727.373832:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039f336e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738331136:0@lo:101: 00010000:00010000:3.0:1789672727.373848:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: 000000006ee5bcbf/0x6c78c4f8c9964d62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672727.373855:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: 000000006ee5bcbf/0x6c78c4f8c9964d62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672727.373932:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f67163d1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738331264:0@lo:501: 00000100:00100000:3.0:1789672727.373972:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672727.374139:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d2762507 going to sleep for 11 seconds 00000100:00100000:2.0:1789672727.377390:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738331264 00000100:00100000:2.0:1789672727.377406:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738331264 00000100:00100000:2.0:1789672727.377460:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789672727.377468:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ff9b948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738331264:12345-0@lo:501: 00000100:00100000:2.0:1789672727.377632:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ff9b948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738331264:12345-0@lo:501: Request processed in 165us (3660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672727.377640:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789672727.377709:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f67163d1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738331264:0@lo:501: 00000100:00100000:2.0:1789672727.377755:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088d4aec0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738331392:0@lo:503: 00000100:00100000:2.0:1789672727.377799:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672727.377817:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f538646d going to sleep for 11 seconds 00000100:00100000:2.0:1789672727.377829:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738331392 00000100:00100000:2.0:1789672727.377838:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738331392 00000100:00100000:2.0:1789672727.377855:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789672727.377860:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d594afb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738331392:12345-0@lo:503: 00000100:00100000:2.0:1789672727.377934:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d594afb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738331392:12345-0@lo:503: Request processed in 74us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672727.377941:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789672727.377974:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088d4aec0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738331392:0@lo:503: 00000100:00100000:2.0:1789672727.378190:0:8068:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088d4aec0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8068:1876607738331520:0@lo:502: 00000100:00100000:2.0:1789672727.378225:0:8068:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672727.378243:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738331520 00000100:00100000:2.0:1789672727.378246:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738331520 00000100:00100000:2.0:1789672727.378264:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789672727.378269:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007b6e9799 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:8068:x1876607738331520:12345-0@lo:502: 00000100:00100000:2.0:1789672727.379859:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007b6e9799 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:8068:x1876607738331520:12345-0@lo:502: Request processed in 1585us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672727.379871:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789672727.379930:0:8068:0:(client.c:2716:ptlrpc_set_wait()) set 0000000083c48059 going to sleep for 11 seconds 00000100:00100000:2.0:1789672727.379949:0:8068:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088d4aec0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8068:1876607738331520:0@lo:502: 00000020:01000000:2.0:1789672727.379982:0:8068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672727.379990:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672727.379993:0:8068:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789672727.379999:0:8068:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfc7c498000 00000020:00000080:2.0:1789672727.380001:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789672727.380049:0:8068:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8068:1876607738331648:0@lo:502: 00000100:00100000:2.0:1789672727.380224:0:8068:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672727.380257:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738331648 00000100:00100000:2.0:1789672727.380263:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738331648 00000100:00100000:2.0:1789672727.380363:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789672727.380372:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:8068:x1876607738331648:12345-0@lo:502: 00000100:00100000:2.0:1789672727.380436:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:8068:x1876607738331648:12345-0@lo:502: Request processed in 65us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672727.380442:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789672727.380470:0:8068:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45e6fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789672727.380481:0:8068:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8068:1876607738331648:0@lo:502: 00000020:01000000:2.0:1789672727.380499:0:8068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672727.380503:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672727.380504:0:8068:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789672727.380507:0:8068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789672727.380575:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789672727.380600:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789672727.380612:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3800/0x6c78c4f8c9964d62 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672727.380624:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3800/0x6c78c4f8c9964d62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672727.380966:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789672727.380970:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc44f3d800 from 1 10000000:01000000:2.0:1789672727.380974:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789672727.381000:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2e00/0x6c78c4f8c9964d70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672727.381009:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2e00/0x6c78c4f8c9964d70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672727.381018:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2e00/0x6c78c4f8c9964d70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672727.381043:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738331776:0@lo:101: 00000100:00100000:2.0:1789672727.381076:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672727.381182:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45e6fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789672727.381200:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738331776 00000100:00100000:2.0:1789672727.381205:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738331776 00000100:00100000:2.0:1789672727.381227:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789672727.381232:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738331776:12345-0@lo:101: 00010000:00010000:2.0:1789672727.381241:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672727.381253:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc427c2400/0x6c78c4f8c9964d77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964d70 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672727.381276:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc427c2400/0x6c78c4f8c9964d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d70 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672727.381856:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc427c2400/0x6c78c4f8c9964d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d70 expref: 18 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672727.381867:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc427c2400, rc 0) 00000100:00100000:2.0:1789672727.382000:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738331776:12345-0@lo:101: Request processed in 767us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672727.382008:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789672727.382846:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738331776:0@lo:101: 00010000:00010000:3.0:1789672727.382870:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2e00/0x6c78c4f8c9964d70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672727.383011:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2e00/0x6c78c4f8c9964d70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672727.384611:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738331904:0@lo:501: 00000100:00100000:3.0:1789672727.384717:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672727.384763:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43435780 going to sleep for 11 seconds 00000100:00100000:0.0:1789672727.384853:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738331904 00000100:00100000:0.0:1789672727.384863:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738331904 00000100:00100000:0.0:1789672727.385009:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789672727.385020:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738331904:12345-0@lo:501: 00000100:00100000:0.0:1789672727.385180:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738331904:12345-0@lo:501: Request processed in 162us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672727.385188:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789672727.385320:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738331904:0@lo:501: 00000100:00100000:3.0:1789672727.385357:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738332032:0@lo:503: 00000100:00100000:3.0:1789672727.385403:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672727.389371:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43435780 going to sleep for 11 seconds 00000100:00100000:2.0:1789672727.389529:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738332032 00000100:00100000:2.0:1789672727.389540:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738332032 00000100:00100000:2.0:1789672727.389594:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789672727.389605:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738332032:12345-0@lo:503: 00000100:00100000:2.0:1789672727.389786:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738332032:12345-0@lo:503: Request processed in 183us (4381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672727.389803:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789672727.390052:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738332032:0@lo:503: 00000100:00100000:3.0:1789672727.390537:0:8070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8070:1876607738332160:0@lo:502: 00000100:00100000:3.0:1789672727.390578:0:8070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672727.390600:0:8070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43435780 going to sleep for 11 seconds 00000100:00100000:0.0:1789672727.390654:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738332160 00000100:00100000:0.0:1789672727.390673:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738332160 00000100:00100000:0.0:1789672727.390698:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789672727.390705:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:8070:x1876607738332160:12345-0@lo:502: 00000100:00100000:0.0:1789672727.390792:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:8070:x1876607738332160:12345-0@lo:502: Request processed in 87us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672727.390799:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789672727.391071:0:8070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8070:1876607738332160:0@lo:502: 00000020:01000000:3.0:1789672727.391091:0:8070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789672727.391109:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672727.391112:0:8070:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789672727.391118:0:8070:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfc44f3d800 00000020:00000080:3.0:1789672727.391121:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789672727.391154:0:8070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8070:1876607738332288:0@lo:502: 00000100:00100000:3.0:1789672727.391184:0:8070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672727.391206:0:8070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc5cf7b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789672727.391341:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738332288 00000100:00100000:0.0:1789672727.391345:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738332288 00000100:00100000:0.0:1789672727.391361:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789672727.391367:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:8070:x1876607738332288:12345-0@lo:502: 00000100:00100000:0.0:1789672727.391430:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:8070:x1876607738332288:12345-0@lo:502: Request processed in 61us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672727.391436:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789672727.391492:0:8070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8070:1876607738332288:0@lo:502: 00000020:01000000:3.0:1789672727.391506:0:8070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789672727.391510:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672727.391511:0:8070:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789672727.391515:0:8070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789672727.391800:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789672727.391821:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789672727.391830:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2e00/0x6c78c4f8c9964d70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672727.391846:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2e00/0x6c78c4f8c9964d70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672727.750907:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672728.776323:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672729.795855:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672730.820824:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672731.463388:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738332416:0@lo:41: 00000100:00100000:0.0:1789672731.463479:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672731.463577:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738332416 00000100:00100000:0.0:1789672731.463588:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738332416 00000100:00100000:0.0:1789672731.463641:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789672731.463651:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738332416:12345-0@lo:41: 00000004:00000024:0.0:1789672731.463707:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789672731.463756:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738332416:12345-0@lo:41: Request processed in 106us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672731.463763:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789672731.463811:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738332416:0@lo:41: 00000100:00100000:0.0:1789672731.464687:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738332544:0@lo:400: 00000100:00100000:0.0:1789672731.464730:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672731.464762:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672731.464768:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738332928:0@lo:400: 00000100:00100000:0.0:1789672731.464794:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672731.464826:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738332800:0@lo:400: 00000100:00100000:0.0:1789672731.464850:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672731.464868:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789672731.464873:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738332672:0@lo:400: 00000100:00100000:0.0:1789672731.464893:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672731.464932:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738332544 00000100:00100000:0.0:1789672731.464937:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738332544 00000100:00100000:0.0:1789672731.464974:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789672731.464982:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:3636:x1876607738332544:12345-0@lo:400: 00000100:00100000:0.0:1789672731.465021:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:3636:x1876607738332544:12345-0@lo:400: Request processed in 40us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672731.465028:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789672731.465056:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738332928 00000100:00100000:0.0:1789672731.465060:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738332928 00000100:00100000:0.0:1789672731.465096:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738332672 00000100:00100000:0.0:1789672731.465099:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738332672 00000100:00100000:0.0:1789672731.465116:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789672731.465122:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738332928:12345-0@lo:400: 00000100:00100000:0.0:1789672731.465153:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738332928:12345-0@lo:400: Request processed in 31us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672731.465159:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789672731.465172:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789672731.465178:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738332672:12345-0@lo:400: 00000100:00100000:0.0:1789672731.465208:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738332672:12345-0@lo:400: Request processed in 30us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672731.465213:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789672731.465243:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc7d93d180 x1876607738332928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672731.465256:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738332928:0@lo:400: 00000100:00100000:0.0:1789672731.465265:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738332544:0@lo:400: 00010000:00080000:0.0:1789672731.465368:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc7d93d500 x1876607738332672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672731.465385:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738332672:0@lo:400: 00000100:00100000:2.0:1789672731.465554:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738332800 00000100:00100000:2.0:1789672731.465559:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738332800 00000100:00100000:2.0:1789672731.465632:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789672731.465642:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738332800:12345-0@lo:400: 00000100:00100000:2.0:1789672731.465718:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738332800:12345-0@lo:400: Request processed in 79us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672731.465726:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789672731.465789:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738332800:0@lo:400: 00010000:00010000:0.0:1789672731.844512:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672732.484783:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672732.484807:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738333056:0@lo:41: 00000100:00100000:2.0:1789672732.484874:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672732.484940:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738333056 00000100:00100000:2.0:1789672732.484948:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738333056 00000100:00100000:2.0:1789672732.484994:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789672732.485017:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738333056:12345-0@lo:41: 00000004:00000024:2.0:1789672732.485062:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1789672732.485110:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738333056:12345-0@lo:41: Request processed in 107us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672732.485118:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789672732.485175:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738333056:0@lo:41: 00010000:00010000:0.0:1789672732.867988:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672733.892577:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789672734.238886:0:8421:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789672734.238890:0:8421:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789672734.238891:0:8421:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789672734.239038:0:8421:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cfc816a3000 00000020:01000004:1.0:1789672734.239054:0:8421:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789672734.239067:0:8421:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789672734.239081:0:8421:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cfc74594d40) 00000020:00000080:1.0:1789672734.239096:0:8421:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789672734.300641:0:8421:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789672734.300739:0:8421:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1789672734.340612:0:8421:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789672734.344882:0:8421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789672734.344898:0:8421:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789672734.344910:0:8421:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6c78c4f8c9964d85 00000020:01000004:3.0:1789672734.344990:0:8421:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789672734.345015:0:8421:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789672734.345028:0:8421:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789672734.345035:0:8421:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789672734.345040:0:8421:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789672734.345054:0:8421:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cfc67f099c0) 00000020:00000080:3.0:1789672734.345065:0:8421:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1789672734.346699:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789672734.346877:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789672734.346884:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789672734.353479:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789672734.353493:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789672734.362098:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789672734.362113:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789672734.367414:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789672734.367600:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789672734.367607:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789672734.368445:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789672734.368454:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789672734.431478:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789672734.431973:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789672734.431981:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789672734.434031:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789672734.434055:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789672734.435850:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789672734.435866:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789672734.439931:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789672734.440324:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789672734.440332:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789672734.442879:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789672734.442910:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789672734.545616:0:8421:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789672734.545873:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789672734.545880:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789672734.549863:0:8421:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789672734.549887:0:8421:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789672734.550506:0:8421:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789672734.550535:0:8421:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789672734.550543:0:8421:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789672734.605268:0:8421:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789672734.605312:0:8421:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.150@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1789672734.605316:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789672734.605318:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789672734.605319:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789672734.605321:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789672734.605322:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789672734.605323:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789672734.605325:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789672734.605327:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789672734.605329:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789672734.605330:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789672734.605331:0:8421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789672734.605335:0:8421:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1789672734.605342:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789672734.605344:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789672734.605345:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789672734.605345:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789672734.605346:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789672734.605347:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789672734.605348:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789672734.605349:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789672734.605350:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789672734.605351:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789672734.605352:0:8421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789672734.605382:0:8421:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789672734.605402:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738333184:0@lo:253: 00000100:00100000:1.0:1789672734.605486:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.605563:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc593a4780 going to sleep for 11 seconds 00000100:00100000:3.0:1789672734.605851:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738333184 00000100:00100000:3.0:1789672734.605862:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738333184 00000100:00100000:3.0:1789672734.605923:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789672734.605933:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:8421:x1876607738333184:12345-0@lo:253: 20000000:01000000:3.0:1789672734.605965:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789672734.605970:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789672734.605975:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789672734.605979:0:6506:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789672734.606213:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672734.606353:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789672734.606369:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789672734.606387:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789672734.606392:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789672734.606406:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789672734.606423:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789672734.606528:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789672734.606544:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.150@tcp 20000000:01000000:3.0:1789672734.606546:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:3.0:1789672734.606562:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789672734.606568:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789672734.606584:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789672734.606590:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:3.0:1789672734.606602:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789672734.606615:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789672734.606631:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789672734.606648:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789672734.606763:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789672734.606773:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.150@tcp 20000000:01000000:3.0:1789672734.606775:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:3.0:1789672734.606786:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789672734.606791:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789672734.606800:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789672734.606804:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:3.0:1789672734.606814:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789672734.606819:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789672734.606830:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789672734.606843:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789672734.607227:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789672734.607241:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.150@tcp 20000000:01000000:3.0:1789672734.607242:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:3.0:1789672734.607256:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789672734.607261:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789672734.607271:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789672734.607276:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:3.0:1789672734.607288:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789672734.607293:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789672734.607326:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789672734.607345:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789672734.607359:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789672734.607363:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789672734.607367:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789672734.607417:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789672734.607420:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789672734.620918:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789672734.621527:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789672734.621583:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789672734.621601:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789672734.621613:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789672734.621616:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789672734.622528:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1789672734.622564:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1789672734.622581:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1789672734.622955:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1789672734.622974:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1789672734.622987:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1789672734.622999:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789672734.623001:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789672734.623513:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1789672734.623542:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1789672734.623558:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789672734.624841:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789672734.624875:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789672734.624891:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789672734.624904:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789672734.624907:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789672734.625842:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1789672734.625880:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1789672734.625897:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789672734.627140:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1789672734.627174:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1789672734.627189:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:1.0:1789672734.627206:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789672734.627230:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964d93 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.627253:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964c58 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.627260:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc61608e00/0x6c78c4f8c9964cd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964ccf expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.627267:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc427c2000/0x6c78c4f8c9964d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d07 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.627273:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc5132ac00/0x6c78c4f8c9964d2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d23 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.627298:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc5132a800/0x6c78c4f8c9964d54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d4d expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.627306:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964d93 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.627444:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc5132a800/0x6c78c4f8c9964d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964d4d expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.627469:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc5132a800/0x6c78c4f8c9964d54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d4d expref: 18 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.627487:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738333312:0@lo:104: 00000100:00100000:1.0:1789672734.627566:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672734.627768:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc5132ac00/0x6c78c4f8c9964d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964d23 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.627777:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc5132ac00/0x6c78c4f8c9964d2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d23 expref: 18 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.627786:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738333440:0@lo:104: 00000100:00100000:1.0:1789672734.627810:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672734.630818:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc427c2000/0x6c78c4f8c9964d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964d07 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.630839:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc427c2000/0x6c78c4f8c9964d0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d07 expref: 18 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.630853:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738333568:0@lo:104: 00000100:00100000:1.0:1789672734.630926:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672734.632802:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738333312 00000100:00100000:2.0:1789672734.632818:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738333312 00000100:00100000:2.0:1789672734.632888:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738333440 00000100:00100000:2.0:1789672734.632892:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738333440 00000100:00100000:2.0:1789672734.632910:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789672734.632918:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:6506:x1876607738333312:12345-0@lo:104: 00010000:00010000:2.0:1789672734.632935:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964d54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.633040:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789672734.633047:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:6506:x1876607738333312:12345-0@lo:104: Request processed in 129us (5481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672734.633054:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789672734.633072:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789672734.633079:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6506:x1876607738333440:12345-0@lo:104: 00010000:00010000:2.0:1789672734.633087:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc5132b200/0x6c78c4f8c9964d23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964d2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.633130:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789672734.633135:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6506:x1876607738333440:12345-0@lo:104: Request processed in 58us (5325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672734.633141:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789672734.633358:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789672734.633366:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964d54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.633375:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435e00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:1.0:1789672734.633379:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964d54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.633387:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964d54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672734.633394:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964d54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672734.633400:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672734.633437:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964d4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.633443:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672734.633464:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964d4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.633471:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964d4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d54 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.633486:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672734.633489:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc5132b200/0x6c78c4f8c9964d23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964d2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.633494:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc5132b200 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:1.0:1789672734.633504:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc5132b200/0x6c78c4f8c9964d23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964d2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.633512:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc5132b200/0x6c78c4f8c9964d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964d2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672734.633518:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc5132b200/0x6c78c4f8c9964d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964d2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672734.633523:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672734.633537:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc5132b200/0x6c78c4f8c9964d23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.633543:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672734.633549:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc5132b200/0x6c78c4f8c9964d23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.633556:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc5132b200/0x6c78c4f8c9964d23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d2a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.633566:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672734.633568:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672734.633569:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672734.633584:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738333696:0@lo:103: 00000100:00100000:1.0:1789672734.633625:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.633680:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789672734.633687:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738333824:0@lo:103: 00000100:00100000:1.0:1789672734.633708:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.633742:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738333696 00000100:00100000:1.0:1789672734.633747:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738333696 00010000:00010000:1.0:1789672734.633774:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc5132a800/0x6c78c4f8c9964d54 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d4d expref: 19 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.633795:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738333824 00000100:00100000:1.0:1789672734.633798:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738333824 00010000:00010000:1.0:1789672734.633809:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc5132ac00/0x6c78c4f8c9964d2a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d23 expref: 20 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.633827:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789672734.633834:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:3637:x1876607738333696:12345-0@lo:103: 00010000:00010000:1.0:1789672734.633845:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672734.633849:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc5132a800/0x6c78c4f8c9964d54 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d4d expref: 20 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.633859:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc5132a800/0x6c78c4f8c9964d54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d4d expref: 20 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.633878:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672734.633906:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:3637:x1876607738333696:12345-0@lo:103: Request processed in 73us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672734.633913:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789672734.633926:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789672734.633931:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:3637:x1876607738333824:12345-0@lo:103: 00010000:00010000:1.0:1789672734.633939:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672734.633942:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc5132ac00/0x6c78c4f8c9964d2a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d23 expref: 19 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.633951:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc5132ac00/0x6c78c4f8c9964d2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d23 expref: 19 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.633969:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672734.633990:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:3637:x1876607738333824:12345-0@lo:103: Request processed in 59us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672734.633996:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789672734.634052:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738333824:0@lo:103: 00000100:00100000:1.0:1789672734.634061:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738333696:0@lo:103: 00010000:00010000:1.0:1789672734.634092:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc61608e00/0x6c78c4f8c9964cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964ccf expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.634103:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc61608e00/0x6c78c4f8c9964cd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964ccf expref: 18 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.634112:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738333952:0@lo:104: 00000100:00100000:1.0:1789672734.634139:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672734.634295:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964c58 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.634305:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964c5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964c58 expref: 18 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.634315:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738334080:0@lo:104: 00000100:00100000:1.0:1789672734.634392:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.634404:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc593a4840 going to sleep for 11 seconds 00010000:00010000:1.0:1789672734.634415:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc5132a800/0x6c78c4f8c9964d54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964d4d expref: 18 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.634425:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738333312:0@lo:104: 00010000:00010000:1.0:1789672734.634444:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc5132ac00/0x6c78c4f8c9964d2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964d23 expref: 17 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.634451:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738333440:0@lo:104: 00010000:00010000:1.0:1789672734.634480:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672734.634912:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738333568 00000100:00100000:2.0:1789672734.634919:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738333568 00000100:00100000:2.0:1789672734.634942:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738333952 00000100:00100000:2.0:1789672734.634945:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738333952 00000100:00100000:2.0:1789672734.634955:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738334080 00000100:00100000:2.0:1789672734.634957:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738334080 00000100:00100000:2.0:1789672734.634969:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789672734.634975:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:6506:x1876607738333568:12345-0@lo:104: 00010000:00010000:2.0:1789672734.634985:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964d07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964d0e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.635057:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789672734.635063:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:6506:x1876607738333568:12345-0@lo:104: Request processed in 88us (4138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672734.635070:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789672734.635084:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789672734.635089:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:6506:x1876607738333952:12345-0@lo:104: 00010000:00010000:2.0:1789672734.635096:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2200/0x6c78c4f8c9964ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964cd6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.635126:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789672734.635131:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:6506:x1876607738333952:12345-0@lo:104: Request processed in 42us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672734.635136:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789672734.635149:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789672734.635155:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6506:x1876607738334080:12345-0@lo:104: 00010000:00010000:2.0:1789672734.635174:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc52434c00/0x6c78c4f8c9964c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964c5f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.635200:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789672734.635205:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6506:x1876607738334080:12345-0@lo:104: Request processed in 51us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672734.635212:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789672734.635303:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738333568:0@lo:104: 00000100:00100000:0.0:1789672734.635312:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738333952:0@lo:104: 00000100:00100000:0.0:1789672734.635317:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738334080:0@lo:104: 00010000:00010000:0.0:1789672734.635352:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964d93 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.635583:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789672734.635590:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964d07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964d0e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.635597:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc427c3400 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:1.0:1789672734.635601:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964d07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964d0e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.635609:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964d0e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672734.635616:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964d0e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672734.635622:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672734.635690:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964d07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d0e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.635698:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672734.635717:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964d07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d0e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.635725:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964d07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d0e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.635736:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789672734.635746:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2200/0x6c78c4f8c9964ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964cd6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.635752:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc427c2200 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:1.0:1789672734.635754:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2200/0x6c78c4f8c9964ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964cd6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.635760:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2200/0x6c78c4f8c9964ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964cd6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672734.635765:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2200/0x6c78c4f8c9964ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964cd6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672734.635770:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672734.635785:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2200/0x6c78c4f8c9964ccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964cd6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.635790:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672734.635795:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2200/0x6c78c4f8c9964ccf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964cd6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.635800:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2200/0x6c78c4f8c9964ccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964cd6 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.635809:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672734.635812:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc52434c00/0x6c78c4f8c9964c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964c5f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.635817:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434c00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:1.0:1789672734.635820:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52434c00/0x6c78c4f8c9964c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964c5f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.635836:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc52434c00/0x6c78c4f8c9964c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964c5f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672734.635843:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52434c00/0x6c78c4f8c9964c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964c5f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672734.635847:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672734.635860:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc52434c00/0x6c78c4f8c9964c58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964c5f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.635865:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672734.635879:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc52434c00/0x6c78c4f8c9964c58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964c5f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.635885:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc52434c00/0x6c78c4f8c9964c58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964c5f expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.635899:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672734.635900:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672734.635902:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672734.635908:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672734.635918:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738334336:0@lo:103: 00000100:00100000:1.0:1789672734.635956:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.635990:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789672734.635995:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738334208:0@lo:103: 00000100:00100000:1.0:1789672734.636028:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.636053:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738334464:0@lo:103: 00000100:00100000:1.0:1789672734.636076:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.636114:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738334336 00000100:00100000:1.0:1789672734.636120:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738334336 00010000:00010000:1.0:1789672734.636143:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc61608e00/0x6c78c4f8c9964cd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964ccf expref: 17 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.636461:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738334208 00000100:00100000:1.0:1789672734.636466:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738334208 00010000:00010000:1.0:1789672734.636480:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc427c2000/0x6c78c4f8c9964d0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d07 expref: 18 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.636491:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738334464 00000100:00100000:1.0:1789672734.636493:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738334464 00010000:00010000:1.0:1789672734.636503:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964c5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964c58 expref: 19 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.636517:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789672734.636525:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:3636:x1876607738334336:12345-0@lo:103: 00010000:00010000:1.0:1789672734.636536:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672734.636541:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc61608e00/0x6c78c4f8c9964cd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964ccf expref: 19 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636551:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc61608e00/0x6c78c4f8c9964cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964ccf expref: 19 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636564:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc61608e00/0x6c78c4f8c9964cd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964ccf expref: 19 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636576:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672734.636611:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:3636:x1876607738334336:12345-0@lo:103: Request processed in 87us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672734.636617:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789672734.636640:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789672734.636645:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:3636:x1876607738334208:12345-0@lo:103: 00010000:00010000:1.0:1789672734.636653:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672734.636685:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc427c2000/0x6c78c4f8c9964d0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d07 expref: 17 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636695:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc427c2000/0x6c78c4f8c9964d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d07 expref: 17 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636705:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc427c2000/0x6c78c4f8c9964d0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964d07 expref: 17 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636713:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672734.636737:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:3636:x1876607738334208:12345-0@lo:103: Request processed in 92us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672734.636743:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789672734.636754:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789672734.636760:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc65c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:3637:x1876607738334464:12345-0@lo:103: 00010000:00010000:1.0:1789672734.636768:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672734.636772:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964c5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964c58 expref: 15 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636780:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964c58 expref: 15 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636790:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964c5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964c58 expref: 15 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636802:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964d93 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636820:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964d93 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636834:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964d93 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636842:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964d93 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636848:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964d93 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636854:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964d93 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636860:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61609000 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789672734.636864:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964d93 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636871:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964d93 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636883:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964d93 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.636893:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672734.636923:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc65c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:3637:x1876607738334464:12345-0@lo:103: Request processed in 162us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672734.636929:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789672734.636995:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738334208:0@lo:103: 00000100:00100000:1.0:1789672734.637025:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738334336:0@lo:103: 00000100:00100000:1.0:1789672734.637053:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738334464:0@lo:103: 00010000:00010000:0.0:1789672734.637138:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964d93 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.637147:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964d93 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.637152:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964d93 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789672734.637178:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789672734.648909:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+13:8421:x1876607738333184:12345-0@lo:253: Request processed in 42966us (43412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672734.648928:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789672734.649097:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738333184:0@lo:253: 10000000:01000000:1.0:1789672734.649114:0:8421:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789672734.649117:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789672734.649119:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789672734.649120:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789672734.649122:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1789672734.649123:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789672734.649124:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789672734.649125:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789672734.649126:0:8421:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789672734.649128:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789672734.649129:0:8421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789672734.649155:0:8421:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfc816a3000 from lustre-OST0000 10000000:01000000:1.0:1789672734.649201:0:8421:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789672734.649204:0:8421:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789672734.649213:0:8421:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cfc499cb380 local copy 10000000:01000000:1.0:1789672734.649217:0:8421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789672734.649252:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964d9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.649263:0:8421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964d9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.649272:0:8421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964d9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.649291:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738334592:0@lo:101: 00000100:00100000:1.0:1789672734.649342:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.649397:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc593a46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672734.649559:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738334592 00000100:00100000:2.0:1789672734.649573:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738334592 00000100:00100000:2.0:1789672734.649694:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789672734.649706:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+13:8421:x1876607738334592:12345-0@lo:101: 00010000:00010000:2.0:1789672734.649721:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672734.649735:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc427c2a00/0x6c78c4f8c9964da1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964d9a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.649759:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc427c2a00/0x6c78c4f8c9964da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d9a expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.649771:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc427c2a00/0x6c78c4f8c9964da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d9a expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.649780:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc427c2a00, rc 0) 00000100:00100000:2.0:1789672734.649816:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:8421:x1876607738334592:12345-0@lo:101: Request processed in 114us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672734.649823:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789672734.649914:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738334592:0@lo:101: 00010000:00010000:1.0:1789672734.649928:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964d9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6c78c4f8c9964da1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.649939:0:8421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964d9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6c78c4f8c9964da1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.650045:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738334720:0@lo:501: 00000100:00100000:1.0:1789672734.650076:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.656919:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc593a46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672734.657514:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738334720 00000100:00100000:0.0:1789672734.657548:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738334720 00000100:00100000:0.0:1789672734.657609:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789672734.657619:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:8421:x1876607738334720:12345-0@lo:501: 00000100:00100000:0.0:1789672734.657792:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:8421:x1876607738334720:12345-0@lo:501: Request processed in 174us (7715us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789672734.657800:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789672734.657931:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738334720:0@lo:501: 10000000:01000000:1.0:1789672734.657953:0:8421:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789672734.657977:0:8421:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789672734.657985:0:8421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964d9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6c78c4f8c9964da1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.657996:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964d9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6c78c4f8c9964da1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.658003:0:8421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6c78c4f8c9964da1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.658037:0:8421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789672734.658076:0:8421:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfc816a3000 10000000:01000000:1.0:1789672734.658081:0:8421:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789672734.658087:0:8421:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789672734.658090:0:8421:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789672734.658095:0:8421:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789672734.658105:0:8421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789672734.658138:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964da8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.658146:0:8421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964da8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.658173:0:8421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964da8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.658193:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738334848:0@lo:101: 00000100:00100000:1.0:1789672734.658228:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.658253:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc593a4b40 going to sleep for 11 seconds 00010000:00010000:0.0:1789672734.658505:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672734.658513:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6c78c4f8c9964da1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.658521:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61609e00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789672734.658525:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6c78c4f8c9964da1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.658534:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x6c78c4f8c9964da1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672734.658541:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x6c78c4f8c9964da1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672734.658547:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789672734.658572:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964d9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6c78c4f8c9964da1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.658578:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672734.658609:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964d9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6c78c4f8c9964da1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.658616:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964d9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6c78c4f8c9964da1 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.658643:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672734.658645:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672734.658647:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672734.658655:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672734.658697:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738334976:0@lo:103: 00000100:00100000:0.0:1789672734.658732:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672734.658765:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738334976 00000100:00100000:0.0:1789672734.658771:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738334976 00000100:00100000:0.0:1789672734.658812:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789672734.658819:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:3637:x1876607738334976:12345-0@lo:103: 00010000:00010000:0.0:1789672734.658830:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672734.658847:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc427c2a00/0x6c78c4f8c9964da1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c9964d9a expref: 14 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.658862:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672734.658894:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+13:3637:x1876607738334976:12345-0@lo:103: Request processed in 75us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672734.658901:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789672734.658936:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738334976:0@lo:103: 00000100:00100000:0.0:1789672734.658952:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738334848 00000100:00100000:0.0:1789672734.658955:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738334848 00000100:00100000:0.0:1789672734.658972:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789672734.658978:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+13:8421:x1876607738334848:12345-0@lo:101: 00010000:00010000:0.0:1789672734.658989:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672734.659005:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964daf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964da8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.659047:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964da8 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.659057:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964da8 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.659065:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435600, rc 0) 00000100:00100000:0.0:1789672734.659094:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:8421:x1876607738334848:12345-0@lo:101: Request processed in 116us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672734.659100:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789672734.659917:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738334848:0@lo:101: 00010000:00010000:1.0:1789672734.659946:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964da8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964daf expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.659959:0:8421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964da8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964daf expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.660144:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738335104:0@lo:501: 00000100:00100000:1.0:1789672734.660214:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.660267:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc593a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672734.660814:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738335104 00000100:00100000:0.0:1789672734.660823:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738335104 00000100:00100000:0.0:1789672734.660861:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789672734.660870:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:8421:x1876607738335104:12345-0@lo:501: 00000100:00100000:0.0:1789672734.661004:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:8421:x1876607738335104:12345-0@lo:501: Request processed in 135us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672734.661023:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789672734.661261:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738335104:0@lo:501: 00000100:00100000:1.0:1789672734.661308:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738335232:0@lo:503: 00000100:00100000:1.0:1789672734.661375:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.661400:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc593a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672734.661563:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738335232 00000100:00100000:0.0:1789672734.661569:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738335232 00000100:00100000:0.0:1789672734.661590:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789672734.661597:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:8421:x1876607738335232:12345-0@lo:503: 00000100:00100000:0.0:1789672734.661721:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:8421:x1876607738335232:12345-0@lo:503: Request processed in 123us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672734.661729:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789672734.661849:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738335232:0@lo:503: 00000040:00080000:1.0:1789672734.662179:0:8421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789672734.662244:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738335360:0@lo:502: 00000100:00100000:1.0:1789672734.662281:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.662313:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc593a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672734.662474:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738335360 00000100:00100000:0.0:1789672734.662479:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738335360 00000100:00100000:0.0:1789672734.662502:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789672734.662516:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:8421:x1876607738335360:12345-0@lo:502: 00000100:00100000:0.0:1789672734.662598:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:8421:x1876607738335360:12345-0@lo:502: Request processed in 82us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672734.662604:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789672734.662803:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738335360:0@lo:502: 00000040:00080000:1.0:1789672734.663030:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789672734.663058:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789672734.663074:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789672734.663089:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789672734.663103:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789672734.663133:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789672734.663155:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738335488:0@lo:502: 00000100:00100000:1.0:1789672734.663270:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.663412:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc593a4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789672734.663497:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738335488 00000100:00100000:2.0:1789672734.663504:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738335488 00000100:00100000:3.0:1789672734.665938:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789672734.665967:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:8421:x1876607738335488:12345-0@lo:502: 00000100:00100000:3.0:1789672734.666153:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:8421:x1876607738335488:12345-0@lo:502: Request processed in 200us (2882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672734.666170:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789672734.666306:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738335488:0@lo:502: 00000040:00080000:1.0:1789672734.666406:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789672734.666420:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789672734.667576:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789672734.667587:0:8444:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789672734.667594:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672734.667596:0:8444:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789672734.667602:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789672734.667617:0:8444:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cfc67f0b380) 00000020:00000080:3.0:1789672734.667640:0:8444:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789672734.667646:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789672734.667918:0:8444:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfc816a3000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789672734.667926:0:8444:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789672734.667938:0:8444:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6c78c4f8c9964dbd 00010000:00010000:1.0:1789672734.682346:0:8444:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1789672734.684111:0:8444:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789672734.688001:0:8444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789672734.690223:0:8444:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789672734.694095:0:8444:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789672734.694311:0:8444:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789672734.701484:0:8444:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1789672734.706554:0:8444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789672734.706569:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789672734.706576:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672734.706578:0:8444:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789672734.706582:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789672734.706586:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672734.706587:0:8444:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789672734.706590:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789672734.706592:0:8444:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789672734.706616:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789672734.706619:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672734.706620:0:8444:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789672734.706624:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789672734.711691:0:8421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789672734.711750:0:8421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789672734.711771:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964da8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964daf expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.711792:0:8421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964da8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964daf expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672734.711801:0:8421:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc816a3000 from 1 10000000:01000000:1.0:1789672734.711804:0:8421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789672734.711846:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9964dc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.711856:0:8421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9964dc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.711870:0:8421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9964dc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.711897:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738335616:0@lo:101: 00000100:00100000:1.0:1789672734.711979:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.712068:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43103780 going to sleep for 11 seconds 00000100:00100000:0.0:1789672734.713214:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738335616 00000100:00100000:0.0:1789672734.713227:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738335616 00000100:00100000:0.0:1789672734.713407:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789672734.713420:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:8421:x1876607738335616:12345-0@lo:101: 00010000:00010000:0.0:1789672734.713439:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672734.713458:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52434c00/0x6c78c4f8c9964dcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964dc4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.713484:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52434c00/0x6c78c4f8c9964dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964dc4 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.713496:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52434c00/0x6c78c4f8c9964dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964dc4 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.713504:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434c00, rc 0) 00000100:00100000:0.0:1789672734.713565:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:8421:x1876607738335616:12345-0@lo:101: Request processed in 148us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672734.713572:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789672734.715616:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738335616:0@lo:101: 00010000:00010000:1.0:1789672734.715645:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9964dc4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964dcb expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.715684:0:8421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9964dc4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964dcb expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.715820:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738335744:0@lo:501: 00000100:00100000:1.0:1789672734.715882:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.715924:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43103780 going to sleep for 11 seconds 00000100:00100000:3.0:1789672734.716006:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738335744 00000100:00100000:3.0:1789672734.716024:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738335744 00000100:00100000:3.0:1789672734.716138:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789672734.716148:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:8421:x1876607738335744:12345-0@lo:501: 00000100:00100000:3.0:1789672734.716263:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:8421:x1876607738335744:12345-0@lo:501: Request processed in 117us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672734.716270:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789672734.716422:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738335744:0@lo:501: 00000100:00100000:1.0:1789672734.716450:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738335872:0@lo:503: 00000100:00100000:1.0:1789672734.720863:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672734.720997:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43103780 going to sleep for 11 seconds 00000100:00100000:3.0:1789672734.721116:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738335872 00000100:00100000:3.0:1789672734.721125:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738335872 00000100:00100000:3.0:1789672734.721212:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789672734.721223:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:8421:x1876607738335872:12345-0@lo:503: 00000100:00100000:3.0:1789672734.721434:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:8421:x1876607738335872:12345-0@lo:503: Request processed in 212us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672734.721442:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789672734.721530:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738335872:0@lo:503: 00000040:00080000:0.0:1789672734.721846:0:8421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789672734.721930:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738336000:0@lo:502: 00000100:00100000:0.0:1789672734.721972:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672734.722596:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc67ebccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672734.722717:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738336000 00000100:00100000:1.0:1789672734.722723:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738336000 00000100:00100000:1.0:1789672734.722757:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789672734.722766:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:8421:x1876607738336000:12345-0@lo:502: 00000100:00100000:1.0:1789672734.722877:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:8421:x1876607738336000:12345-0@lo:502: Request processed in 111us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672734.722883:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789672734.722982:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738336000:0@lo:502: 00000040:00080000:0.0:1789672734.723233:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789672734.723259:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789672734.723283:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738336128:0@lo:502: 00000100:00100000:0.0:1789672734.723323:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672734.723360:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43103780 going to sleep for 11 seconds 00000100:00100000:1.0:1789672734.723524:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738336128 00000100:00100000:1.0:1789672734.723530:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738336128 00000100:00100000:1.0:1789672734.723551:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789672734.723558:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:8421:x1876607738336128:12345-0@lo:502: 00000100:00100000:1.0:1789672734.723641:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:8421:x1876607738336128:12345-0@lo:502: Request processed in 82us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672734.723648:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789672734.723790:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738336128:0@lo:502: 00000040:00080000:0.0:1789672734.723832:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789672734.723840:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789672734.724326:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672734.724348:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672734.724350:0:8448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789672734.724356:0:8448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfc816a3000 00000020:00000080:0.0:1789672734.724359:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789672734.724372:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672734.724374:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672734.724376:0:8448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789672734.724379:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789672734.724558:0:8421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789672734.724594:0:8421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789672734.724618:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9964dc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964dcb expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.724630:0:8421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9964dc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964dcb expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672734.724720:0:8421:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789672734.724724:0:8421:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfc816a3000 10000000:01000000:1.0:1789672734.724727:0:8421:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfc816a3000 10000000:01000000:1.0:1789672734.724740:0:8421:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789672734.724747:0:8421:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfc816a3000 from 1 10000000:01000000:1.0:1789672734.724750:0:8421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789672734.724777:0:8421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964dd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.724786:0:8421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964dd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.724796:0:8421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964dd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.724813:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738336256:0@lo:101: 00000100:00100000:1.0:1789672734.724865:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.724899:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc593a4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789672734.724917:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738336256 00000100:00100000:1.0:1789672734.724922:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738336256 00000100:00100000:1.0:1789672734.724944:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789672734.724952:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:8421:x1876607738336256:12345-0@lo:101: 00010000:00010000:1.0:1789672734.724963:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672734.724974:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964dd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964dd2 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.724996:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964dd2 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.725006:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964dd2 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.725024:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc61609000, rc 0) 00000100:00100000:1.0:1789672734.725140:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:8421:x1876607738336256:12345-0@lo:101: Request processed in 188us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672734.725147:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789672734.725182:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738336256:0@lo:101: 00010000:00010000:1.0:1789672734.725195:0:8421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964dd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964dd9 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.725204:0:8421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964dd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964dd9 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672734.725274:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738336384:0@lo:501: 00000100:00100000:1.0:1789672734.725298:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.725310:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc593a4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789672734.725322:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738336384 00000100:00100000:1.0:1789672734.725325:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738336384 00000100:00100000:1.0:1789672734.725425:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789672734.725432:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:8421:x1876607738336384:12345-0@lo:501: 00000100:00100000:1.0:1789672734.725517:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:8421:x1876607738336384:12345-0@lo:501: Request processed in 85us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672734.725524:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789672734.725552:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738336384:0@lo:501: 00000100:00100000:1.0:1789672734.725576:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738336512:0@lo:503: 00000100:00100000:1.0:1789672734.725607:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.725620:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc593a4780 going to sleep for 11 seconds 00000100:00100000:1.0:1789672734.725632:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738336512 00000100:00100000:1.0:1789672734.725636:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738336512 00000100:00100000:1.0:1789672734.725651:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789672734.726258:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:8421:x1876607738336512:12345-0@lo:503: 00000100:00100000:1.0:1789672734.726404:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:8421:x1876607738336512:12345-0@lo:503: Request processed in 150us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672734.726411:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789672734.726459:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738336512:0@lo:503: 00000040:00080000:1.0:1789672734.726693:0:8421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789672734.726768:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738336640:0@lo:502: 00000100:00100000:1.0:1789672734.726823:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.726850:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc5cf7b300 going to sleep for 11 seconds 00000100:00100000:1.0:1789672734.726866:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738336640 00000100:00100000:1.0:1789672734.726871:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738336640 00000100:00100000:1.0:1789672734.726893:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789672734.726899:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:8421:x1876607738336640:12345-0@lo:502: 00000100:00100000:1.0:1789672734.726981:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:8421:x1876607738336640:12345-0@lo:502: Request processed in 82us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672734.726988:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789672734.730506:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738336640:0@lo:502: 00000040:00080000:1.0:1789672734.730954:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789672734.730989:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789672734.731004:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789672734.731033:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789672734.731294:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789672734.731312:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789672734.731407:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789672734.731429:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789672734.731463:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789672734.731481:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789672734.731505:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789672734.731518:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789672734.731531:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789672734.731544:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789672734.731555:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789672734.731565:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789672734.731578:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789672734.731592:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789672734.731605:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789672734.731619:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789672734.731632:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789672734.731644:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789672734.731939:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789672734.731965:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789672734.731990:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789672734.732003:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789672734.732031:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789672734.732117:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789672734.732134:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789672734.732148:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789672734.732572:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789672734.732595:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789672734.732609:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789672734.732621:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789672734.732634:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789672734.732646:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789672734.732727:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1789672734.732778:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738336768:0@lo:502: 00000100:00100000:1.0:1789672734.732958:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.733147:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc5cf7b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789672734.733489:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738336768 00000100:00100000:0.0:1789672734.733499:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738336768 00000100:00100000:0.0:1789672734.733587:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789672734.733599:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:8421:x1876607738336768:12345-0@lo:502: 00000100:00100000:0.0:1789672734.734274:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:8421:x1876607738336768:12345-0@lo:502: Request processed in 675us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672734.734283:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789672734.734502:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738336768:0@lo:502: 00000040:00080000:1.0:1789672734.734602:0:8421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789672734.734616:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789672734.735930:0:8449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789672734.735961:0:8449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cfb4661cd40) 00000020:00000080:1.0:1789672734.735985:0:8449:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789672734.736295:0:8449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfc816a3000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789672734.736300:0:8449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfc816a3000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789672734.736302:0:8449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfc816a3000 3 00010000:00080000:1.0:1789672734.736408:0:8449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfc462e3000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.150@tcp at head 00010000:00010000:1.0:1789672734.739408:0:8449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1789672734.739767:0:8449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789672734.739821:0:8449:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789672734.739834:0:8449:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6c78c4f8c9964de7 00000100:00080000:1.0:1789672734.739845:0:8449:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789672734.739857:0:8449:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cfc462e3000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789672734.739895:0:8449:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc462ded80 x1876607738336896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789672734.739920:0:8449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789672734.740088:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876607738336896:0@lo:38: 00000100:00100000:0.0:1789672734.740157:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.740301:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738336896 00000100:00100000:1.0:1789672734.740311:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738336896 00000100:00100000:1.0:1789672734.740354:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789672734.740361:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1876607738336896:12345-0@lo:38: 00010000:00080000:1.0:1789672734.740385:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:1.0:1789672734.740432:0:6514:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6c78c4f8c9964dee 00000004:00100000:1.0:1789672734.740445:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789672734.740471:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8cfb4676c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789672734.740515:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876607738336896:12345-0@lo:38: Request processed in 153us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672734.740526:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789672734.740648:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc462ded80 x1876607738336896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789672744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672734.740689:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789672734.740696:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789672734.740703:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789672734.740707:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789672734.740710:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc462e3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789672734.740716:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876607738336896:0@lo:38: 00000100:00100000:3.0:1789672734.740886:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738337408:0@lo:400: 00000100:00100000:3.0:1789672734.740922:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672734.740955:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672734.740962:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738337280:0@lo:400: 00000100:00100000:3.0:1789672734.740983:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672734.741008:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738337408 00000100:00100000:3.0:1789672734.741023:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738337408 00000100:00100000:0.0:1789672734.741175:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738337024:0@lo:400: 00000100:00100000:0.0:1789672734.741203:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672734.741223:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672734.741229:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738337152:0@lo:400: 00000100:00100000:0.0:1789672734.741250:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672734.741280:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738337280 00000100:00100000:0.0:1789672734.741284:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738337280 00000100:00100000:0.0:1789672734.741306:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738337024 00000100:00100000:0.0:1789672734.741309:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738337024 00000100:00100000:0.0:1789672734.741323:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789672734.741341:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738337280:12345-0@lo:400: 00000100:00100000:0.0:1789672734.741378:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738337280:12345-0@lo:400: Request processed in 38us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672734.741384:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789672734.741397:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789672734.741402:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738337024:12345-0@lo:400: 00000100:00100000:0.0:1789672734.741427:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738337024:12345-0@lo:400: Request processed in 25us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672734.741432:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789672734.741458:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738337152 00000100:00100000:0.0:1789672734.741461:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738337152 00000100:00100000:0.0:1789672734.741482:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789672734.741489:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738337152:12345-0@lo:400: 00000100:00100000:0.0:1789672734.741519:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738337152:12345-0@lo:400: Request processed in 31us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672734.741524:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789672734.741551:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738337152:0@lo:400: 00010000:00080000:0.0:1789672734.741561:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc7c407800 x1876607738337024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672734.741570:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738337024:0@lo:400: 00010000:00080000:0.0:1789672734.741592:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc7c407b80 x1876607738337280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672734.741600:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738337280:0@lo:400: 00000100:00100000:3.0:1789672734.741778:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789672734.741787:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738337408:12345-0@lo:400: 00000100:00100000:3.0:1789672734.743086:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738337408:12345-0@lo:400: Request processed in 1296us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672734.743097:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789672734.743248:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738337408:0@lo:400: 00000020:01000004:3.0:1789672734.744160:0:8449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789672734.744195:0:8449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8cfb467719c0) 00000020:00000080:3.0:1789672734.744219:0:8449:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1789672734.744299:0:8449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfc816a3000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789672734.744303:0:8449:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfc816a3000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789672734.744306:0:8449:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfc816a3000 3 00010000:00080000:3.0:1789672734.744473:0:8449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfb419e3000@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.150@tcp at head 00010000:00010000:0.0:1789672734.757060:0:8449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1789672734.757315:0:8449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789672734.757512:0:8449:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789672734.757525:0:8449:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x6c78c4f8c9964dfc 00000100:00080000:0.0:1789672734.757534:0:8449:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789672734.757547:0:8449:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8cfb419e3000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789672734.757582:0:8449:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d93c700 x1876607738337536/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789672734.757617:0:8449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789672734.757714:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1876607738337536:0@lo:38: 00000100:00100000:2.0:1789672734.757787:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672734.757846:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738337536 00000100:00100000:2.0:1789672734.757854:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738337536 00000100:00100000:2.0:1789672734.757888:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789672734.757896:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1876607738337536:12345-0@lo:38: 00010000:00080000:2.0:1789672734.757927:0:6513:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:2.0:1789672734.757965:0:6513:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x6c78c4f8c9964e03 00000004:00100000:2.0:1789672734.757980:0:6513:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789672734.758019:0:6513:0:(import.c:65:import_set_state_nolock()) ffff8cfc81a26000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789672734.758099:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1876607738337536:12345-0@lo:38: Request processed in 202us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672734.758106:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789672734.758130:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc7d93c700 x1876607738337536/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789672744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672734.758213:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789672734.758220:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789672734.758228:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789672734.758232:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789672734.758234:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb419e3000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789672734.758241:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1876607738337536:0@lo:38: 00000040:00080000:3.0:1789672734.759021:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1789672734.759299:0:8421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789672734.759335:0:8421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789672734.759353:0:8421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964dd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964dd9 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.759366:0:8421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964dd9 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789672734.759420:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789672734.759422:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789672734.759423:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789672734.759424:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789672734.759425:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789672734.759426:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789672734.759427:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789672734.759428:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789672734.759429:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789672734.759430:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789672734.759431:0:8421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789672734.759435:0:8421:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789672734.759436:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789672734.759437:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789672734.759438:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789672734.759438:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789672734.759439:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789672734.759440:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789672734.759440:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789672734.759441:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789672734.759442:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789672734.759443:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789672734.759443:0:8421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789672734.759463:0:8421:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789672734.759475:0:8421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738337664:0@lo:253: 00000100:00100000:1.0:1789672734.759533:0:8421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672734.759572:0:8421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc452dd840 going to sleep for 11 seconds 00000100:00100000:0.0:1789672734.759574:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738337664 00000100:00100000:0.0:1789672734.759582:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738337664 00000100:00100000:0.0:1789672734.759628:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789672734.759639:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:8421:x1876607738337664:12345-0@lo:253: 20000000:01000000:0.0:1789672734.759688:0:6507:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789672734.759701:0:6507:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789672734.774029:0:6507:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789672734.774058:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789672734.774067:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789672734.774073:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789672734.774099:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9964e0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672734.774118:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc61608600/0x6c78c4f8c9964d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964cf9 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672734.774126:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c9964d1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d15 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672734.774132:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9964e0a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672734.774181:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c9964d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964d15 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672734.774193:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c9964d1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d15 expref: 16 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672734.774208:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876607738337792:0@lo:104: 00000100:00100000:3.0:1789672734.774279:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672734.774378:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc61608600/0x6c78c4f8c9964d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964cf9 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672734.774387:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc61608600/0x6c78c4f8c9964d00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964cf9 expref: 16 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672734.774394:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876607738337920:0@lo:104: 00000100:00100000:3.0:1789672734.774415:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb419de780 going to sleep for 11 seconds 00000100:00100000:2.0:1789672734.774527:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789672734.774546:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672734.774574:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738337792 00000100:00100000:2.0:1789672734.774583:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738337792 00000100:00100000:2.0:1789672734.774627:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738337920 00000100:00100000:2.0:1789672734.774630:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738337920 00000100:00100000:2.0:1789672734.774648:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789672734.774957:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:8421:x1876607738337664:12345-0@lo:253: Request processed in 15320us (15421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672734.774968:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789672734.775062:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81586c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:6528:x1876607738337792:12345-0@lo:104: 00010000:00010000:2.0:1789672734.775077:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc5132a400/0x6c78c4f8c9964d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964d1c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.775158:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789672734.775165:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81586c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:6528:x1876607738337792:12345-0@lo:104: Request processed in 510us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672734.775171:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789672734.775206:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789672734.775213:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6528:x1876607738337920:12345-0@lo:104: 00010000:00010000:2.0:1789672734.775221:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc5132ae00/0x6c78c4f8c9964cf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964d00 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672734.775237:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876607738337792:0@lo:104: 00000100:00100000:0.0:1789672734.775246:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876607738337920:0@lo:104: 00010000:00010000:2.0:1789672734.775252:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789672734.775256:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6528:x1876607738337920:12345-0@lo:104: Request processed in 44us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672734.775261:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789672734.775267:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9964e0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.775283:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789672734.775289:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc5132a400/0x6c78c4f8c9964d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964d1c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.775295:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc5132a400 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789672734.775300:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc5132a400/0x6c78c4f8c9964d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964d1c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.775308:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc5132a400/0x6c78c4f8c9964d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964d1c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672734.775318:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc5132a400/0x6c78c4f8c9964d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964d1c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672734.775322:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789672734.775358:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc5132a400/0x6c78c4f8c9964d15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d1c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.775364:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672734.775385:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc5132a400/0x6c78c4f8c9964d15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d1c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.775393:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc5132a400/0x6c78c4f8c9964d15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d1c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.775406:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672734.775409:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc5132ae00/0x6c78c4f8c9964cf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964d00 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.775415:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc5132ae00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789672734.775417:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc5132ae00/0x6c78c4f8c9964cf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964d00 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.775424:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc5132ae00/0x6c78c4f8c9964cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964d00 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672734.775431:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc5132ae00/0x6c78c4f8c9964cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964d00 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672734.775436:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789672734.775462:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc5132ae00/0x6c78c4f8c9964cf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d00 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.775468:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672734.775474:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc5132ae00/0x6c78c4f8c9964cf9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d00 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.775480:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc5132ae00/0x6c78c4f8c9964cf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d00 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.775493:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672734.775495:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672734.775496:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672734.775508:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738338048:0@lo:103: 00000100:00100000:0.0:1789672734.775533:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672734.775564:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672734.775570:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738338176:0@lo:103: 00000100:00100000:2.0:1789672734.775572:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738338048 00000100:00100000:2.0:1789672734.775577:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738338048 00000100:00100000:0.0:1789672734.775589:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789672734.775599:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c9964d1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d15 expref: 16 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672734.775619:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738338176 00000100:00100000:2.0:1789672734.775622:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738338176 00000100:00100000:0.0:1789672734.775622:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789672734.775629:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:3635:x1876607738338048:12345-0@lo:103: 00010000:00010000:2.0:1789672734.775631:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc61608600/0x6c78c4f8c9964d00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964cf9 expref: 17 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672734.775639:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672734.775644:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c9964d1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d15 expref: 17 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672734.775646:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789672734.775651:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:3635:x1876607738338176:12345-0@lo:103: 00010000:00010000:2.0:1789672734.775678:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672734.775681:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c9964d1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d15 expref: 17 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.775683:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc61608600/0x6c78c4f8c9964d00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964cf9 expref: 17 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.775692:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc61608600/0x6c78c4f8c9964d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964cf9 expref: 17 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672734.775737:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672734.775888:0:8421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8421:1876607738337664:0@lo:253: 10000000:01000000:3.0:1789672734.775903:0:8421:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789672734.775906:0:8421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789672734.775908:0:8421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789672734.775910:0:8421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789672734.775911:0:8421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789672734.775912:0:8421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789672734.775914:0:8421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789672734.775916:0:8421:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789672734.775918:0:8421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789672734.775919:0:8421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789672734.775921:0:8421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789672734.775923:0:8421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789672734.775935:0:8421:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789672734.782326:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c9964d1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964d15 expref: 17 pid: 6506 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.782336:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc61608600/0x6c78c4f8c9964d00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964cf9 expref: 17 pid: 6504 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.782356:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9964e0a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.782365:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9964e0a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789672734.783201:0:8421:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789672734.783326:0:8421:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789672734.783478:0:8421:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789672734.783587:0:8421:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789672734.786253:0:8421:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789672734.786547:0:8421:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 20000000:01000000:2.0:1789672734.790154:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016080574s 00010000:00010000:2.0:1789672734.790171:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9964e0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.790182:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9964e0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.790206:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9964e0a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.790215:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9964e0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.790222:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886200 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789672734.790226:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9964e0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.790235:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9964e0a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.790262:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9964e0a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.790277:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672734.790315:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9964e0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.790323:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9964e0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672734.790340:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9964e0a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672734.790435:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:3635:x1876607738338176:12345-0@lo:103: Request processed in 14778us (14840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672734.790446:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789672734.790506:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738338176:0@lo:103: 00010000:00010000:0.0:1789672734.791083:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672734.791396:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:3635:x1876607738338048:12345-0@lo:103: Request processed in 15764us (15857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672734.791406:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789672734.791781:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738338048:0@lo:103: 00000001:00000004:1.0:1789672734.791980:0:8421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789672734.802582:0:8421:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789672734.802593:0:8421:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789672734.802636:0:8421:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789672734.802773:0:8421:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789672734.802795:0:8421:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789672734.802896:0:8421:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789672734.803730:0:8421:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789672734.803921:0:8421:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789672734.941988:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789672735.368951:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789672735.368960:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfc7c498000 from 30 10000000:01000000:0.0:1789672735.368965:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789672735.369021:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52434200/0x6c78c4f8c9964e11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672735.369085:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc52434200/0x6c78c4f8c9964e11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672735.369095:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc52434200/0x6c78c4f8c9964e11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672735.369117:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738338304:0@lo:101: 00000100:00100000:0.0:1789672735.369195:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.369278:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45e6f300 going to sleep for 11 seconds 00000100:00100000:3.0:1789672735.370135:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738338304 00000100:00100000:3.0:1789672735.370146:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738338304 00000100:00100000:3.0:1789672735.370212:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789672735.370223:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:6509:x1876607738338304:12345-0@lo:101: 00010000:00010000:3.0:1789672735.370239:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672735.370255:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d886600/0x6c78c4f8c9964e18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964e11 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672735.370282:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d886600/0x6c78c4f8c9964e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e11 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672735.370293:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d886600/0x6c78c4f8c9964e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e11 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672735.370303:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886600, rc 0) 00000100:00100000:3.0:1789672735.370396:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:6509:x1876607738338304:12345-0@lo:101: Request processed in 176us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672735.370401:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789672735.376505:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738338304:0@lo:101: 00010000:00010000:1.0:1789672735.376548:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc52434200/0x6c78c4f8c9964e11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e18 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672735.376563:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc52434200/0x6c78c4f8c9964e11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964e18 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672735.376682:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738338432:0@lo:501: 00000100:00100000:1.0:1789672735.376769:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672735.377634:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789672735.379590:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738338432 00000100:00100000:3.0:1789672735.380135:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738338432 00000100:00100000:3.0:1789672735.380211:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789672735.380222:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:6509:x1876607738338432:12345-0@lo:501: 00000100:00100000:3.0:1789672735.380496:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:6509:x1876607738338432:12345-0@lo:501: Request processed in 275us (3725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672735.380516:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789672735.384500:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738338432:0@lo:501: 00000100:00100000:2.0:1789672735.384570:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738338560:0@lo:503: 00000100:00100000:2.0:1789672735.384673:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672735.384712:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805780 going to sleep for 11 seconds 00000100:00100000:0.0:1789672735.384721:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738338560 00000100:00100000:0.0:1789672735.384729:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738338560 00000100:00100000:0.0:1789672735.384782:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789672735.384791:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:6509:x1876607738338560:12345-0@lo:503: 00000100:00100000:0.0:1789672735.384896:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:6509:x1876607738338560:12345-0@lo:503: Request processed in 105us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672735.384903:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789672735.385649:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738338560:0@lo:503: 00000100:00100000:2.0:1789672735.387896:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8480:1876607738338688:0@lo:502: 00000100:00100000:2.0:1789672735.388020:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672735.388077:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738338688 00000100:00100000:2.0:1789672735.388084:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738338688 00000100:00100000:2.0:1789672735.388136:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789672735.388145:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:8480:x1876607738338688:12345-0@lo:502: 00000100:00100000:2.0:1789672735.388269:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:8480:x1876607738338688:12345-0@lo:502: Request processed in 123us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672735.388276:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789672735.388321:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805780 going to sleep for 11 seconds 00000100:00100000:2.0:1789672735.388337:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8480:1876607738338688:0@lo:502: 00000100:00100000:2.0:1789672735.388383:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8480:1876607738338816:0@lo:502: 00000100:00100000:2.0:1789672735.388408:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672735.388424:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738338816 00000100:00100000:2.0:1789672735.388426:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738338816 00000100:00100000:2.0:1789672735.388441:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789672735.388445:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:8480:x1876607738338816:12345-0@lo:502: 00000100:00100000:2.0:1789672735.388497:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:8480:x1876607738338816:12345-0@lo:502: Request processed in 50us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672735.388510:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789672735.388537:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805780 going to sleep for 11 seconds 00000100:00100000:2.0:1789672735.388548:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8480:1876607738338816:0@lo:502: 00000040:00080000:2.0:1789672735.388564:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789672735.389055:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789672735.389087:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789672735.389100:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52434200/0x6c78c4f8c9964e11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e18 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672735.389113:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc52434200/0x6c78c4f8c9964e11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e18 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672735.389123:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789672735.389126:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfc7c498000 from 5 10000000:01000000:3.0:1789672735.389128:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789672735.389156:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887000/0x6c78c4f8c9964e1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672735.389165:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887000/0x6c78c4f8c9964e1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672735.389174:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887000/0x6c78c4f8c9964e1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672735.389188:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738338944:0@lo:101: 00000100:00100000:3.0:1789672735.389223:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672735.389260:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb419ace40 going to sleep for 11 seconds 00000100:00100000:2.0:1789672735.390094:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738338944 00000100:00100000:2.0:1789672735.390103:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738338944 00000100:00100000:2.0:1789672735.390152:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789672735.390161:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:6509:x1876607738338944:12345-0@lo:101: 00010000:00010000:2.0:1789672735.390174:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672735.390188:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc427c3c00/0x6c78c4f8c9964e26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964e1f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.390211:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc427c3c00/0x6c78c4f8c9964e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e1f expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.390223:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc427c3c00/0x6c78c4f8c9964e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e1f expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.390233:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc427c3c00, rc 0) 00000100:00100000:2.0:1789672735.390292:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738338944:12345-0@lo:101: Request processed in 133us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672735.390300:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789672735.390347:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738338944:0@lo:101: 00010000:00010000:2.0:1789672735.390362:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887000/0x6c78c4f8c9964e1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e26 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.390371:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887000/0x6c78c4f8c9964e1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964e26 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672735.390430:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738339072:0@lo:256: 00000100:00100000:2.0:1789672735.390468:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672735.390508:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805900 going to sleep for 11 seconds 00000100:00100000:2.0:1789672735.390520:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738339072 00000100:00100000:2.0:1789672735.390524:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738339072 00000100:00100000:2.0:1789672735.390543:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789672735.390549:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738339072:12345-0@lo:256: 20000000:01000000:2.0:1789672735.390564:0:6507:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789672735.390581:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789672735.390584:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789672735.390677:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738339072:12345-0@lo:256: Request processed in 109us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672735.390684:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789672735.390714:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738339072:0@lo:256: 10000000:01000000:2.0:1789672735.390752:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789672735.390759:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887000/0x6c78c4f8c9964e1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e26 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.390768:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887000/0x6c78c4f8c9964e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e26 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672735.390777:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789672735.390779:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1789672735.390782:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789672735.390799:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2a00/0x6c78c4f8c9964e2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.390817:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2a00/0x6c78c4f8c9964e2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.390826:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2a00/0x6c78c4f8c9964e2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672735.390837:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738339200:0@lo:101: 00000100:00100000:2.0:1789672735.390863:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672735.390881:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805900 going to sleep for 11 seconds 00000100:00100000:2.0:1789672735.390892:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738339200 00000100:00100000:2.0:1789672735.390895:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738339200 00000100:00100000:2.0:1789672735.390915:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789672735.390921:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738339200:12345-0@lo:101: 00010000:00010000:2.0:1789672735.390928:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672735.390937:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964e34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964e2d expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.390967:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e2d expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.390976:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e2d expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.390983:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc427c3200, rc 0) 00000100:00100000:2.0:1789672735.391023:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738339200:12345-0@lo:101: Request processed in 101us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672735.391029:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789672735.391057:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738339200:0@lo:101: 00010000:00010000:2.0:1789672735.391071:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2a00/0x6c78c4f8c9964e2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e34 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.391079:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2a00/0x6c78c4f8c9964e2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964e34 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672735.391126:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738339328:0@lo:501: 00000100:00100000:2.0:1789672735.391150:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672735.391163:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805900 going to sleep for 11 seconds 00000100:00100000:2.0:1789672735.391174:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738339328 00000100:00100000:2.0:1789672735.391177:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738339328 00000100:00100000:2.0:1789672735.391197:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789672735.391203:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738339328:12345-0@lo:501: 00000100:00100000:2.0:1789672735.391315:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738339328:12345-0@lo:501: Request processed in 112us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672735.391322:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789672735.391349:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738339328:0@lo:501: 00000100:00100000:2.0:1789672735.391373:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738339456:0@lo:503: 00000100:00100000:2.0:1789672735.391412:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672735.391424:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805900 going to sleep for 11 seconds 00000100:00100000:2.0:1789672735.391436:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738339456 00000100:00100000:2.0:1789672735.391440:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738339456 00000100:00100000:2.0:1789672735.391459:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789672735.391465:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738339456:12345-0@lo:503: 00000100:00100000:2.0:1789672735.391541:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738339456:12345-0@lo:503: Request processed in 74us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672735.391548:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789672735.391590:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738339456:0@lo:503: 00000100:00100000:2.0:1789672735.392653:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8481:1876607738339584:0@lo:502: 00000100:00100000:2.0:1789672735.392921:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672735.392954:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672735.393052:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738339584 00000100:00100000:0.0:1789672735.393060:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738339584 00000100:00100000:0.0:1789672735.393108:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789672735.393117:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:8481:x1876607738339584:12345-0@lo:502: 00000100:00100000:0.0:1789672735.393397:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:8481:x1876607738339584:12345-0@lo:502: Request processed in 281us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672735.393410:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789672735.393818:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8481:1876607738339584:0@lo:502: 00000020:01000000:1.0:1789672735.393856:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789672735.393865:0:8481:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789672735.393874:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672735.393876:0:8481:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789672735.393881:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789672735.393885:0:8481:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:1.0:1789672735.393911:0:8481:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789672735.393919:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789672735.393937:0:8481:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8cfb46618000) 00000020:00000080:1.0:1789672735.393963:0:8481:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1789672735.393969:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789672735.394189:0:8481:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789672735.394197:0:8481:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789672735.394204:0:8481:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c78c4f8c9964e42 00010000:00080000:1.0:1789672735.394233:0:8481:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfb4676a000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:1.0:1789672735.394502:0:8481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789672735.432223:0:8481:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789672735.432254:0:8481:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789672735.435339:0:8481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672735.435633:0:8481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672735.435743:0:8481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789672735.435830:0:8481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789672735.436247:0:8485:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672735.436252:0:8485:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789672735.438751:0:8481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789672735.438785:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789672735.438836:0:8481:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789672735.438863:0:8481:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c78c4f8c9964e49 00000100:00080000:2.0:1789672735.438875:0:8481:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789672735.438885:0:8481:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cfb4676a000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789672735.438924:0:8481:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc462ea300 x1876607738339712/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789672735.439305:0:8481:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1789672735.439440:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738340096:0@lo:400: 00000020:01000000:2.0:1789672735.439465:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672735.439469:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672735.439471:0:8481:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000100:00100000:3.0:1789672735.439509:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672735.439564:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672735.439570:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738340224:0@lo:400: 00000100:00100000:3.0:1789672735.439594:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1789672735.439641:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672735.439648:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672735.439650:0:8481:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789672735.439679:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789672735.439682:0:8481:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789672735.439709:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8481:1876607738340608:0@lo:502: 00000100:00100000:2.0:1789672735.439749:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672735.439771:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672735.439848:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738339712:0@lo:8: 00000100:00100000:0.0:1789672735.439884:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.439927:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738339840:0@lo:400: 00000100:00100000:0.0:1789672735.439964:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.439985:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738340352:0@lo:400: 00000100:00100000:0.0:1789672735.440016:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.440042:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789672735.440048:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738339968:0@lo:400: 00000100:00100000:0.0:1789672735.440088:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738340096 00000100:00100000:0.0:1789672735.440096:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738340096 00000100:00100000:0.0:1789672735.440135:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738339840 00000100:00100000:0.0:1789672735.440148:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738339840 00000100:00100000:0.0:1789672735.440161:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738340352 00000100:00100000:0.0:1789672735.440164:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738340352 00000100:00100000:0.0:1789672735.440193:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789672735.440202:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738340096:12345-0@lo:400: 00000100:00100000:0.0:1789672735.440259:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738340096:12345-0@lo:400: Request processed in 57us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672735.440267:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789672735.440282:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789672735.440288:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738339840:12345-0@lo:400: 00000100:00100000:0.0:1789672735.440319:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738339840:12345-0@lo:400: Request processed in 31us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672735.440324:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789672735.440336:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789672735.440340:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7c407b80 x1876607738340096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672735.440348:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738340352:12345-0@lo:400: 00000100:00100000:3.0:1789672735.440354:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738340096:0@lo:400: 00000100:00100000:0.0:1789672735.440751:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738340352:12345-0@lo:400: Request processed in 401us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672735.440759:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789672735.440784:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672735.440849:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738339712 00000100:00100000:2.0:1789672735.440855:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738339712 00000100:00100000:2.0:1789672735.440878:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789672735.440883:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876607738339712:12345-0@lo:8: 00010000:00080000:2.0:1789672735.440906:0:8428:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:2.0:1789672735.440953:0:8428:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c78c4f8c9964e50 00002000:00100000:2.0:1789672735.440990:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8cfc81a25000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789672735.440994:0:8428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1789672735.441011:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789672735.441081:0:8428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789672735.441283:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789672735.441306:0:8428:0:(import.c:65:import_set_state_nolock()) ffff8cfc81a23800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789672735.441352:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1876607738339712:12345-0@lo:8: Request processed in 468us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672735.441358:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789672735.444143:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876607738340480:0@lo:400: 00000100:00100000:0.0:1789672735.444203:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789672735.444249:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7c407800 x1876607738339840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672735.444264:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738340480 00000100:00100000:0.0:1789672735.444264:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738339840:0@lo:400: 00000100:00100000:3.0:1789672735.444271:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738340480 00010000:00080000:0.0:1789672735.444276:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7c405880 x1876607738340352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672735.444283:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738340352:0@lo:400: 00010000:00080000:0.0:1789672735.444319:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462ea300 x1876607738339712/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789672745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672735.444324:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789672735.444328:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:3.0:1789672735.444333:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876607738340480:12345-0@lo:400: 00000100:00080000:0.0:1789672735.444335:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789672735.444341:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789672735.444347:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789672735.444349:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb4676a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789672735.444359:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789672735.444363:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738339712:0@lo:8: 00000100:00100000:3.0:1789672735.444385:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876607738340480:12345-0@lo:400: Request processed in 54us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672735.444392:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789672735.444408:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8486:1876607738340736:0@lo:700: 00010000:00080000:3.0:1789672735.444426:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7dac2a00 x1876607738340480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672735.444433:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672735.444436:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876607738340480:0@lo:400: 00000100:00100000:0.0:1789672735.444449:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45e6f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789672735.444459:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738340736 00000100:00100000:3.0:1789672735.444462:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738340736 00000100:00100000:3.0:1789672735.444492:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789672735.444499:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8486:x1876607738340736:12345-0@lo:700: 00000100:00100000:3.0:1789672735.444528:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8436:1876607738340864:0@lo:700: 00000100:00100000:3.0:1789672735.444573:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672735.444606:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb419accc0 going to sleep for 11 seconds 00000004:00080000:3.0:1789672735.444625:0:8485:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789672735.444724:0:8485:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 213360064905ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789672735.444730:0:8485:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789672735.444815:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738340864 00000100:00100000:0.0:1789672735.444820:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738340864 00000100:00100000:0.0:1789672735.444849:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789672735.444855:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8436:x1876607738340864:12345-0@lo:700: 00000100:00080000:0.0:1789672735.446428:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789672735.446435:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789672735.446437:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672735.446451:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738340608 00000100:00100000:0.0:1789672735.446459:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738340608 00000100:00100000:0.0:1789672735.446510:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789672735.446515:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:8481:x1876607738340608:12345-0@lo:502: 00000100:00100000:0.0:1789672735.446674:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:8481:x1876607738340608:12345-0@lo:502: Request processed in 141us (6907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672735.446682:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789672735.446706:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8481:1876607738340608:0@lo:502: 00000020:01000000:3.0:1789672735.446739:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789672735.446746:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672735.446749:0:8481:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789672735.446754:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:1.0:1789672735.447326:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738340224 00000100:00100000:1.0:1789672735.447332:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738340224 00000100:00100000:1.0:1789672735.447369:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738339968 00000100:00100000:1.0:1789672735.447372:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738339968 00000100:00100000:1.0:1789672735.447387:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789672735.447396:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738340224:12345-0@lo:400: 00000100:00100000:1.0:1789672735.447449:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738340224:12345-0@lo:400: Request processed in 54us (7853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672735.447455:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789672735.447471:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789672735.447488:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738339968:12345-0@lo:400: 00000100:00100000:1.0:1789672735.447532:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738339968:12345-0@lo:400: Request processed in 55us (6747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672735.447548:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789672735.447594:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738340224:0@lo:400: 00000100:00100000:3.0:1789672735.447634:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738339968:0@lo:400: 00000020:01000000:0.0:1789672735.449398:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1789672735.449435:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789672735.449448:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2a00/0x6c78c4f8c9964e2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e34 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672735.449461:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2a00/0x6c78c4f8c9964e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e34 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672735.449472:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789672735.450559:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfc44f3d800 from 30 10000000:01000000:0.0:1789672735.450570:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789672735.450617:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52435800/0x6c78c4f8c9964e57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672735.450628:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc52435800/0x6c78c4f8c9964e57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672735.450650:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc52435800/0x6c78c4f8c9964e57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672735.452177:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738340992:0@lo:101: 00000100:00100000:0.0:1789672735.452253:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.452296:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3600 going to sleep for 11 seconds 00000100:00100000:0.0:1789672735.452338:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738340992 00000100:00100000:0.0:1789672735.452347:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738340992 00000100:00100000:0.0:1789672735.452406:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789672735.452415:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738340992:12345-0@lo:101: 00010000:00010000:0.0:1789672735.452434:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672735.452453:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52435400/0x6c78c4f8c9964e5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964e57 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672735.452483:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52435400/0x6c78c4f8c9964e5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e57 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672735.452497:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52435400/0x6c78c4f8c9964e5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e57 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672735.452507:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435400, rc 0) 00000100:00100000:0.0:1789672735.452546:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738340992:12345-0@lo:101: Request processed in 131us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672735.452552:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789672735.452599:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738340992:0@lo:101: 00010000:00010000:0.0:1789672735.452630:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc52435800/0x6c78c4f8c9964e57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672735.452652:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc52435800/0x6c78c4f8c9964e57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672735.452736:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738341120:0@lo:501: 00000100:00100000:0.0:1789672735.452761:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.452781:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3600 going to sleep for 11 seconds 00000100:00100000:0.0:1789672735.452793:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738341120 00000100:00100000:0.0:1789672735.452796:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738341120 00000100:00100000:0.0:1789672735.452818:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789672735.452824:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738341120:12345-0@lo:501: 00000100:00100000:0.0:1789672735.452950:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738341120:12345-0@lo:501: Request processed in 125us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672735.452957:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789672735.452985:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738341120:0@lo:501: 00000100:00100000:0.0:1789672735.454267:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738341248:0@lo:503: 00000100:00100000:0.0:1789672735.454325:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.454407:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3600 going to sleep for 11 seconds 00000004:00080000:1.0:1789672735.454712:0:7443:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789672735.456781:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738341248 00000100:00100000:2.0:1789672735.456794:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738341248 00000100:00100000:2.0:1789672735.459162:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789672735.459176:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738341248:12345-0@lo:503: 00000100:00100000:2.0:1789672735.459359:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738341248:12345-0@lo:503: Request processed in 186us (5034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672735.459368:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789672735.459463:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738341248:0@lo:503: 00000100:00100000:0.0:1789672735.459775:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8488:1876607738341376:0@lo:502: 00000100:00100000:0.0:1789672735.459819:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.459844:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789672735.459870:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738341376 00000100:00100000:1.0:1789672735.459877:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738341376 00000100:00100000:1.0:1789672735.459917:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789672735.459924:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:8488:x1876607738341376:12345-0@lo:502: 00000100:00100000:1.0:1789672735.460297:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:8488:x1876607738341376:12345-0@lo:502: Request processed in 102us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672735.460306:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789672735.460486:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8488:1876607738341376:0@lo:502: 00000100:00100000:0.0:1789672735.460533:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8488:1876607738341504:0@lo:502: 00000100:00100000:0.0:1789672735.460565:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.460583:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789672735.461113:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738341504 00000100:00100000:1.0:1789672735.461127:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738341504 00000100:00100000:1.0:1789672735.461168:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789672735.461175:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:8488:x1876607738341504:12345-0@lo:502: 00000100:00100000:1.0:1789672735.461492:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:8488:x1876607738341504:12345-0@lo:502: Request processed in 317us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672735.461500:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 40000000:02000000:0.0:1789672735.463621:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1789672735.464680:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8488:1876607738341504:0@lo:502: 00000040:00080000:2.0:1789672735.464746:0:8488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789672735.464840:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789672735.464865:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789672735.464877:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52435800/0x6c78c4f8c9964e57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.464890:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc52435800/0x6c78c4f8c9964e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672735.464922:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789672735.464924:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfc44f3d800 from 5 10000000:01000000:2.0:1789672735.464928:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789672735.464965:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2000/0x6c78c4f8c9964e65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.464974:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2000/0x6c78c4f8c9964e65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.464984:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2000/0x6c78c4f8c9964e65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672735.465019:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738341632:0@lo:101: 00000100:00100000:2.0:1789672735.465086:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672735.465128:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805540 going to sleep for 11 seconds 00000100:00100000:2.0:1789672735.465964:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738341632 00000100:00100000:2.0:1789672735.465974:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738341632 00000100:00100000:2.0:1789672735.466052:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789672735.466063:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738341632:12345-0@lo:101: 00010000:00010000:2.0:1789672735.466080:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672735.466098:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc427c2200/0x6c78c4f8c9964e6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964e65 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.466128:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc427c2200/0x6c78c4f8c9964e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e65 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.466140:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc427c2200/0x6c78c4f8c9964e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e65 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.466164:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc427c2200, rc 0) 00000100:00100000:2.0:1789672735.466238:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:6509:x1876607738341632:12345-0@lo:101: Request processed in 176us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672735.466245:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789672735.466521:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738341632:0@lo:101: 00010000:00010000:1.0:1789672735.466539:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2000/0x6c78c4f8c9964e65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672735.466548:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2000/0x6c78c4f8c9964e65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672735.466608:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738341760:0@lo:256: 00000100:00100000:1.0:1789672735.466653:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672735.466715:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935600 going to sleep for 11 seconds 00000100:00100000:3.0:1789672735.466769:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738341760 00000100:00100000:3.0:1789672735.466775:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738341760 00000100:00100000:3.0:1789672735.466814:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789672735.466824:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:6509:x1876607738341760:12345-0@lo:256: 20000000:01000000:3.0:1789672735.466839:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789672735.466859:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789672735.466862:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789672735.466938:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:6509:x1876607738341760:12345-0@lo:256: Request processed in 116us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672735.466957:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789672735.467139:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738341760:0@lo:256: 10000000:01000000:1.0:1789672735.467183:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789672735.467189:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2000/0x6c78c4f8c9964e65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672735.467198:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2000/0x6c78c4f8c9964e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672735.467207:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789672735.467209:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789672735.467212:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789672735.467230:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609800/0x6c78c4f8c9964e73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672735.467237:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc61609800/0x6c78c4f8c9964e73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672735.467244:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc61609800/0x6c78c4f8c9964e73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672735.467256:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738341888:0@lo:101: 00000100:00100000:1.0:1789672735.467280:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672735.467304:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935600 going to sleep for 11 seconds 00000100:00100000:1.0:1789672735.467317:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738341888 00000100:00100000:1.0:1789672735.467321:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738341888 00000100:00100000:1.0:1789672735.467338:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789672735.467343:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:6509:x1876607738341888:12345-0@lo:101: 00010000:00010000:1.0:1789672735.467359:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672735.467368:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc61609600/0x6c78c4f8c9964e7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964e73 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672735.467385:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc61609600/0x6c78c4f8c9964e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e73 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672735.467394:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc61609600/0x6c78c4f8c9964e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e73 expref: 20 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672735.467401:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc61609600, rc 0) 00000100:00100000:1.0:1789672735.467427:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738341888:12345-0@lo:101: Request processed in 84us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672735.467433:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789672735.467456:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738341888:0@lo:101: 00010000:00010000:1.0:1789672735.467465:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc61609800/0x6c78c4f8c9964e73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e7a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672735.467472:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc61609800/0x6c78c4f8c9964e73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964e7a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672735.467519:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738342016:0@lo:501: 00000100:00100000:1.0:1789672735.467541:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672735.467555:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935600 going to sleep for 11 seconds 00000100:00100000:1.0:1789672735.467566:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738342016 00000100:00100000:1.0:1789672735.467569:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738342016 00000100:00100000:1.0:1789672735.467584:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789672735.467589:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738342016:12345-0@lo:501: 00000100:00100000:1.0:1789672735.467756:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738342016:12345-0@lo:501: Request processed in 166us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672735.467762:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789672735.467795:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738342016:0@lo:501: 00000100:00100000:1.0:1789672735.467813:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738342144:0@lo:503: 00000100:00100000:1.0:1789672735.467841:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672735.467866:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935600 going to sleep for 11 seconds 00000100:00100000:2.0:1789672735.467875:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738342144 00000100:00100000:2.0:1789672735.467879:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738342144 00000100:00100000:2.0:1789672735.467899:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789672735.467905:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738342144:12345-0@lo:503: 00000100:00100000:2.0:1789672735.468011:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738342144:12345-0@lo:503: Request processed in 92us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672735.468018:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789672735.468506:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738342144:0@lo:503: 00000100:00100000:1.0:1789672735.473511:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8490:1876607738342272:0@lo:502: 00000100:00100000:1.0:1789672735.473611:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672735.473684:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738342272 00000100:00100000:1.0:1789672735.473695:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738342272 00000100:00100000:1.0:1789672735.473747:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789672735.473756:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:8490:x1876607738342272:12345-0@lo:502: 00000100:00100000:1.0:1789672735.473879:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:8490:x1876607738342272:12345-0@lo:502: Request processed in 122us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672735.473887:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789672735.473952:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789672735.473973:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8490:1876607738342272:0@lo:502: 00000020:01000000:1.0:1789672735.474008:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789672735.474017:0:8490:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789672735.474025:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672735.474107:0:8490:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789672735.474113:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789672735.474118:0:8490:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000100:00100000:0.0:1789672735.475319:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8436:x1876607738340864:12345-0@lo:700: Request processed in 30457us (30739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672735.475334:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789672735.475424:0:8436:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7dac2a00 x1876607738340864/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789672751 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672735.475439:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8436:1876607738340864:0@lo:700: 40000000:02000000:2.0:1789672735.475450:0:8436:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000020:01000000:1.0:1789672735.477392:0:8490:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789672735.477407:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789672735.477429:0:8490:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cfb466199c0) 00000020:00000080:1.0:1789672735.477456:0:8490:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1789672735.477463:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789672735.477602:0:8490:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789672735.477610:0:8490:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789672735.477618:0:8490:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c78c4f8c9964e88 00010000:00080000:1.0:1789672735.477677:0:8490:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfc7f514800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:1.0:1789672735.477971:0:8490:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:3.0:1789672735.485710:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789672735.485978:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8486:x1876607738340736:12345-0@lo:700: Request processed in 41472us (41536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672735.486010:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789672735.486133:0:8486:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7d93f800 x1876607738340736/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789672751 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672735.486162:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8486:1876607738340736:0@lo:700: 00000040:01000000:3.0:1789672735.493193:0:8490:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789672735.493221:0:8490:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789672735.493434:0:8490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672735.493634:0:8490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672735.493763:0:8490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789672735.493862:0:8490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789672735.495200:0:8492:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789672735.495208:0:8492:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000004:00080000:0.0:1789672735.498623:0:8486:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789672735.498680:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8486:1876607738342528:0@lo:7: 00000100:00100000:0.0:1789672735.498748:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.498807:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672735.498823:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672735.498836:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738342400:0@lo:13: 00000100:00100000:0.0:1789672735.498882:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.498924:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738342400 00000100:00100000:0.0:1789672735.498931:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738342400 00000100:00100000:0.0:1789672735.498976:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789672735.498985:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738342400:12345-0@lo:13: 00002000:00000024:0.0:1789672735.499018:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:0.0:1789672735.499205:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738342400:12345-0@lo:13: Request processed in 220us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672735.499213:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789672735.499275:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc4993ca80 x1876607738342400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672735.499295:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738342400:0@lo:13: 00000100:00100000:3.0:1789672735.499747:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738342528 00000100:00100000:3.0:1789672735.499754:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738342528 00000100:00100000:3.0:1789672735.499838:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789672735.499848:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8486:x1876607738342528:12345-0@lo:7: 00000020:00000080:2.0:1789672735.501992:0:8490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789672735.502018:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789672735.502134:0:8490:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789672735.502404:0:8490:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c78c4f8c9964e8f 00000100:00080000:2.0:1789672735.502415:0:8490:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789672735.502426:0:8490:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cfc7f514800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789672735.502463:0:8490:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc462eb100 x1876607738342656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789672735.502522:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738342656:0@lo:8: 00000100:00100000:0.0:1789672735.502619:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672735.502697:0:8429:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789672735.502707:0:8429:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1789672735.502722:0:8490:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789672735.502797:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672735.502806:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672735.502808:0:8490:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789672735.502812:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672735.502816:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1789672735.502816:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738342656 00000020:00000080:2.0:1789672735.502817:0:8490:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789672735.502820:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789672735.502822:0:8490:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789672735.502823:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738342656 00000100:00100000:2.0:1789672735.502843:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8490:1876607738342784:0@lo:502: 00000100:00100000:2.0:1789672735.502883:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672735.502905:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738342784 00000100:00100000:2.0:1789672735.502908:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738342784 00000100:00100000:2.0:1789672735.502939:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789672735.502943:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789672735.502947:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:8490:x1876607738342784:12345-0@lo:502: 00000100:00100000:1.0:1789672735.502948:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3634:x1876607738342656:12345-0@lo:8: 00010000:00080000:1.0:1789672735.502970:0:8494:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1789672735.503017:0:8494:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c78c4f8c9964e96 00002000:00100000:1.0:1789672735.503031:0:8494:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cfc7f510800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789672735.503036:0:8494:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789672735.503039:0:8494:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789672735.503112:0:8494:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789672735.503134:0:8494:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f516000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789672735.503218:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:8490:x1876607738342784:12345-0@lo:502: Request processed in 199us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672735.503225:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789672735.503442:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d8050c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672735.503461:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:8490:1876607738342784:0@lo:502: 00000020:01000000:2.0:1789672735.503484:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672735.503489:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672735.503490:0:8490:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789672735.503496:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789672735.503555:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789672735.503577:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789672735.503587:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609800/0x6c78c4f8c9964e73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e7a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.503598:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc61609800/0x6c78c4f8c9964e73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964e7a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672735.503616:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789672735.503619:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cfc499cb380 from 1 10000000:01000000:2.0:1789672735.503622:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789672735.503641:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964e9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.503648:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964e9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.503673:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964e9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672735.503685:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738342912:0@lo:101: 00000100:00100000:2.0:1789672735.503715:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672735.503734:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d8050c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672735.503747:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738342912 00000100:00100000:2.0:1789672735.503752:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738342912 00000100:00100000:2.0:1789672735.503778:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789672735.503785:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738342912:12345-0@lo:101: 00010000:00010000:2.0:1789672735.503794:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672735.503806:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc427c3000/0x6c78c4f8c9964ea4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964e9d expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.503827:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc427c3000/0x6c78c4f8c9964ea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e9d expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.503834:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc427c3000/0x6c78c4f8c9964ea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e9d expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.503847:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc427c3000, rc 0) 00000100:00100000:2.0:1789672735.503868:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738342912:12345-0@lo:101: Request processed in 85us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672735.503872:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789672735.503893:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738342912:0@lo:101: 00010000:00010000:2.0:1789672735.503902:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964e9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964ea4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.503908:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964e9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964ea4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672735.503936:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738343040:0@lo:501: 00000100:00100000:2.0:1789672735.503951:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672735.503959:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d8050c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672735.503967:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738343040 00000100:00100000:2.0:1789672735.503969:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738343040 00000100:00100000:2.0:1789672735.503983:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789672735.503986:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738343040:12345-0@lo:501: 00000100:00100000:1.0:1789672735.504096:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3634:x1876607738342656:12345-0@lo:8: Request processed in 1145us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672735.504104:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789672735.504193:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462eb100 x1876607738342656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789672745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672735.504204:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789672735.504211:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789672735.504218:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789672735.504223:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789672735.504226:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f514800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789672735.504275:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789672735.504281:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738342656:0@lo:8: 00000004:00080000:1.0:1789672735.504805:0:8492:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789672735.505180:0:8492:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 213420520495ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789672735.505194:0:8492:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789672735.505844:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738343040:12345-0@lo:501: Request processed in 1853us (1887us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789672735.505853:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789672735.505896:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738343040:0@lo:501: 10000000:01000000:2.0:1789672735.505928:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789672735.505936:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964e9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964ea4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672735.505952:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964e9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964ea4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789672735.507302:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789672735.507310:0:8430:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789672735.507392:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8486:x1876607738342528:12345-0@lo:7: Request processed in 7545us (8642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672735.507402:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:1.0:1789672735.508718:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:0.0:1789672735.508917:0:8486:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc4993dc00 x1876607738342528/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789672751 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672735.508934:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8486:1876607738342528:0@lo:7: 00000004:00080000:0.0:1789672735.508963:0:8486:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789672735.509022:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8486:1876607738343168:0@lo:5: 00000100:00100000:0.0:1789672735.509152:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.509180:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672735.509201:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738343168 00000100:00100000:0.0:1789672735.509206:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738343168 00000100:00100000:0.0:1789672735.509248:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789672735.509257:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8486:x1876607738343168:12345-0@lo:5: 00002000:00080000:0.0:1789672735.509284:0:8429:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789672735.509319:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8486:x1876607738343168:12345-0@lo:5: Request processed in 62us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672735.509326:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789672735.509355:0:8486:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7d93b800 x1876607738343168/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789672751 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672735.509371:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8486:1876607738343168:0@lo:5: 00000004:00080000:0.0:1789672735.509383:0:8486:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789672735.509407:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8486:1876607738343296:0@lo:5: 00000100:00100000:0.0:1789672735.509428:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.509476:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672735.509516:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672735.509526:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738343424:0@lo:13: 00000100:00100000:0.0:1789672735.509551:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.509574:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738343424 00000100:00100000:0.0:1789672735.509577:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738343424 00000100:00100000:0.0:1789672735.509603:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789672735.509607:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1876607738343424:12345-0@lo:13: 00002000:00000024:0.0:1789672735.509629:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:0.0:1789672735.509653:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1876607738343424:12345-0@lo:13: Request processed in 46us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672735.509685:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789672735.509702:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789672735.509721:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7d93ad80 x1876607738343424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672735.509736:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738343424:0@lo:13: 00000004:00080000:0.0:1789672735.509749:0:8493:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789672735.509762:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8493:1876607738343552:0@lo:7: 00000100:00100000:0.0:1789672735.509782:0:8493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.510169:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672735.510231:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738343296 00000100:00100000:2.0:1789672735.510237:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738343296 00000100:00100000:3.0:1789672735.510274:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738343552 00000100:00100000:3.0:1789672735.510278:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738343552 00000100:00100000:3.0:1789672735.510338:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789672735.510348:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8493:x1876607738343552:12345-0@lo:7: 00002000:00080000:3.0:1789672735.512875:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789672735.512883:0:8430:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789672735.512987:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8493:x1876607738343552:12345-0@lo:7: Request processed in 2637us (3199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672735.513010:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789672735.513097:0:8493:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7d93ad80 x1876607738343552/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789672751 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672735.513113:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8493:1876607738343552:0@lo:7: 00000004:00080000:1.0:1789672735.513153:0:8493:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789672735.513194:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8493:1876607738343680:0@lo:5: 00000100:00100000:0.0:1789672735.513205:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789672735.513229:0:8493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.513253:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738343680 00000100:00100000:1.0:1789672735.513257:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8486:x1876607738343296:12345-0@lo:5: 00000100:00100000:0.0:1789672735.513259:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738343680 00000100:00100000:0.0:1789672735.513280:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789672735.513286:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8493:x1876607738343680:12345-0@lo:5: 00002000:00080000:1.0:1789672735.513291:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00002000:00080000:0.0:1789672735.513297:0:8428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789672735.513299:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789672735.513792:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672735.516651:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8486:x1876607738343296:12345-0@lo:5: Request processed in 3432us (7216us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789672735.516684:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789672735.516771:0:8486:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7d93b800 x1876607738343296/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789672751 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672735.516789:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8486:1876607738343296:0@lo:5: 00000004:00080000:0.0:1789672735.516823:0:8486:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1789672735.516861:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d939180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8486:1876607738343808:0@lo:900: 00000100:00100000:0.0:1789672735.516890:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.516943:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3e40 going to sleep for 11 seconds 00000001:00080000:0.0:1789672735.517501:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1789672735.517513:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789672735.517608:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738343808 00000100:00100000:1.0:1789672735.517616:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738343808 00000100:00100000:2.0:1789672735.517625:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8493:x1876607738343680:12345-0@lo:5: Request processed in 4338us (4396us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789672735.517632:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789672735.517696:0:8493:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462df800 x1876607738343680/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789672751 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672735.517704:0:8493:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789672735.517708:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8493:1876607738343680:0@lo:5: 00000004:00080000:0.0:1789672735.517716:0:8493:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789672735.517742:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8493:1876607738343936:0@lo:700: 00000100:00100000:0.0:1789672735.517762:0:8493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672735.517782:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672735.517803:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738343936 00000100:00100000:2.0:1789672735.517812:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738343936 00000100:00100000:2.0:1789672735.517840:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789672735.517849:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8493:x1876607738343936:12345-0@lo:700: 00000100:00100000:1.0:1789672735.517923:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789672735.517930:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8486:x1876607738343808:12345-0@lo:900: 00000100:00100000:1.0:1789672735.517971:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8486:x1876607738343808:12345-0@lo:900: Request processed in 42us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672735.517978:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789672735.518135:0:8486:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7d939180 x1876607738343808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789672751 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672735.518151:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d939180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8486:1876607738343808:0@lo:900: 00000001:00080000:0.0:1789672735.527420:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:2.0:1789672735.527591:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8493:x1876607738343936:12345-0@lo:700: Request processed in 9737us (9821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672735.527605:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789672735.528071:0:8493:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7d93a680 x1876607738343936/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789672751 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672735.528097:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8493:1876607738343936:0@lo:700: 00000004:02000040:0.0:1789672735.531328:0:8493:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1789672735.536400:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8493:1876607738344064:0@lo:5: 00000100:00100000:2.0:1789672735.536482:0:8493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672735.536547:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d8050c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672735.536614:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738344064 00000100:00100000:3.0:1789672735.536623:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738344064 00000100:00100000:3.0:1789672735.536703:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789672735.536714:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8493:x1876607738344064:12345-0@lo:5: 00002000:00080000:3.0:1789672735.542543:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789672735.542565:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00010000:00080000:1.0:1789672735.545941:0:8493:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462e8a80 x1876607738344064/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789672751 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672735.545977:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8493:1876607738344064:0@lo:5: 00000004:00080000:1.0:1789672735.545992:0:8493:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:3.0:1789672735.546079:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8493:x1876607738344064:12345-0@lo:5: Request processed in 8921us (9151us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789672735.546093:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000020:00000004:3.0:1789672735.788873:0:8514:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789672735.789079:0:8514:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789672735.959359:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672736.585244:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738344192:0@lo:41: 00000100:00100000:0.0:1789672736.585316:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672736.588630:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738344192 00000100:00100000:1.0:1789672736.588644:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738344192 00000100:00100000:1.0:1789672736.588724:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789672736.588735:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738344192:12345-0@lo:41: 00000004:00000024:1.0:1789672736.588772:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789672736.588864:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738344192:12345-0@lo:41: Request processed in 131us (3547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672736.588871:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789672736.588930:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738344192:0@lo:41: 00010000:00010000:3.0:1789672736.974881:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672737.603843:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789672737.603871:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738344320:0@lo:41: 00000100:00100000:2.0:1789672737.603948:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672737.604022:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738344320 00000100:00100000:2.0:1789672737.604029:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738344320 00000100:00100000:2.0:1789672737.604073:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789672737.604081:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738344320:12345-0@lo:41: 00000004:00000024:2.0:1789672737.604114:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789672737.604158:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738344320:12345-0@lo:41: Request processed in 77us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672737.604178:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789672737.604222:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738344320:0@lo:41: 00010000:00010000:1.0:1789672737.991941:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672739.023588:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672740.038815:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672740.675860:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738344448:0@lo:13: 00000100:00100000:0.0:1789672740.675954:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672740.676072:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738344448 00000100:00100000:0.0:1789672740.676082:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738344448 00000100:00100000:0.0:1789672740.676149:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789672740.676160:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1876607738344448:12345-0@lo:13: 00002000:00000024:0.0:1789672740.676190:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672740.676249:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1876607738344448:12345-0@lo:13: Request processed in 92us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672740.676257:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789672740.676287:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789672740.676321:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7d938700 x1876607738344448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672740.676340:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738344448:0@lo:13: 00000100:00100000:2.0:1789672740.677737:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738344576:0@lo:13: 00000100:00100000:2.0:1789672740.677806:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672740.677857:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738344576 00000100:00100000:2.0:1789672740.677863:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738344576 00000100:00100000:2.0:1789672740.677924:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789672740.677933:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738344576:12345-0@lo:13: 00002000:00000024:2.0:1789672740.677953:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672740.677994:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738344576:12345-0@lo:13: Request processed in 62us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672740.678009:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789672740.678032:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789672740.678054:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462eb100 x1876607738344576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672740.678065:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789672740.678089:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738344576:0@lo:13: 00000100:00100000:3.0:1789672740.679520:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738344832:0@lo:400: 00000100:00100000:3.0:1789672740.679575:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672740.679603:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738345344:0@lo:400: 00000100:00100000:3.0:1789672740.679636:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672740.679687:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789672740.679693:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738344704:0@lo:400: 00000100:00100000:3.0:1789672740.679720:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672740.679739:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738345216:0@lo:400: 00000100:00100000:3.0:1789672740.679761:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672740.679796:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738344832 00000100:00100000:3.0:1789672740.679803:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738344832 00000100:00100000:3.0:1789672740.679843:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738345344 00000100:00100000:3.0:1789672740.679846:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738345344 00000100:00100000:3.0:1789672740.679874:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789672740.679882:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738344832:12345-0@lo:400: 00000100:00100000:3.0:1789672740.679944:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738344832:12345-0@lo:400: Request processed in 63us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672740.679951:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789672740.679966:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789672740.679973:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738345344:12345-0@lo:400: 00000100:00100000:2.0:1789672740.681121:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738344704 00000100:00100000:2.0:1789672740.681132:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738344704 00000100:00100000:2.0:1789672740.681177:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789672740.681185:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3638:x1876607738344704:12345-0@lo:400: 00000100:00100000:2.0:1789672740.681260:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3638:x1876607738344704:12345-0@lo:400: Request processed in 76us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672740.681266:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789672740.681432:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738345344:12345-0@lo:400: Request processed in 28us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672740.681442:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789672740.681480:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738345216 00000100:00100000:3.0:1789672740.681484:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738345216 00000100:00100000:3.0:1789672740.681522:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789672740.681529:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738345216:12345-0@lo:400: 00000100:00100000:3.0:1789672740.681572:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738345216:12345-0@lo:400: Request processed in 44us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672740.681578:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789672740.681599:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672740.681616:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738345088:0@lo:400: 00000100:00100000:3.0:1789672740.681649:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672740.681688:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789672740.681696:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738344960:0@lo:400: 00000100:00100000:3.0:1789672740.681720:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672740.681739:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738345472:0@lo:400: 00000100:00100000:3.0:1789672740.681757:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672740.681783:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738345088 00000100:00100000:3.0:1789672740.681787:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738345088 00000100:00100000:3.0:1789672740.681808:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738345472 00000100:00100000:3.0:1789672740.681811:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738345472 00000100:00100000:3.0:1789672740.681831:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789672740.681836:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738345088:12345-0@lo:400: 00000100:00100000:3.0:1789672740.681870:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738345088:12345-0@lo:400: Request processed in 33us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672740.681876:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789672740.681887:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789672740.681893:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738345472:12345-0@lo:400: 00000100:00100000:3.0:1789672740.681928:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738345472:12345-0@lo:400: Request processed in 35us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672740.681941:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1789672740.681958:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789672740.681983:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738344704:0@lo:400: 00000100:00100000:3.0:1789672740.681997:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738345216:0@lo:400: 00000100:00100000:2.0:1789672740.682873:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738344960 00000100:00100000:2.0:1789672740.682891:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738344960 00000100:00100000:2.0:1789672740.683127:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789672740.683136:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738344960:12345-0@lo:400: 00000100:00100000:2.0:1789672740.683202:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738344960:12345-0@lo:400: Request processed in 68us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672740.683207:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789672740.684402:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7dac0000 x1876607738344832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672740.684421:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738344832:0@lo:400: 00010000:00080000:3.0:1789672740.684437:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7dac1180 x1876607738345344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672740.684446:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738345344:0@lo:400: 00000100:00100000:3.0:1789672740.684525:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738344960:0@lo:400: 00010000:00080000:3.0:1789672740.684537:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7dac0380 x1876607738345472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672740.684546:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738345472:0@lo:400: 00010000:00080000:3.0:1789672740.684556:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7dac1500 x1876607738345088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672740.684563:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738345088:0@lo:400: 00010000:00010000:3.0:1789672741.071246:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789672741.199243:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1789672741.699966:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738345600:0@lo:41: 00000100:00100000:3.0:1789672741.700056:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672741.700168:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738345600 00000100:00100000:3.0:1789672741.700178:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738345600 00000100:00100000:3.0:1789672741.700247:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789672741.700258:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738345600:12345-0@lo:41: 00000004:00000024:3.0:1789672741.700294:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789672741.700347:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738345600:12345-0@lo:41: Request processed in 91us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672741.700355:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789672741.700403:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738345600:0@lo:41: 00010000:00010000:1.0:1789672742.087706:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672742.727097:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672742.727129:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738345728:0@lo:41: 00000100:00100000:2.0:1789672742.727220:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672742.727296:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738345728 00000100:00100000:2.0:1789672742.727305:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738345728 00000100:00100000:2.0:1789672742.727366:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789672742.727375:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738345728:12345-0@lo:41: 00000004:00000024:2.0:1789672742.727413:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789672742.727476:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738345728:12345-0@lo:41: Request processed in 101us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672742.727483:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789672742.727536:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738345728:0@lo:41: 00000001:02000400:3.0:1789672742.729363:0:8804:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789672743.107793:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789672743.953625:0:8856:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789672743.960366:0:8856:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789672744.137970:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672745.156134:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672745.796242:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789672745.796276:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738345984:0@lo:13: 00000100:00100000:1.0:1789672745.796357:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672745.796428:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738345856:0@lo:13: 00000100:00100000:1.0:1789672745.796455:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672745.796574:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738345984 00000100:00100000:0.0:1789672745.796585:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738345984 00000100:00100000:2.0:1789672745.796588:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738345856 00000100:00100000:2.0:1789672745.796596:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738345856 00000100:00100000:0.0:1789672745.796676:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789672745.796690:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738345984:12345-0@lo:13: 00002000:00000024:0.0:1789672745.796750:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672745.796787:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738346112:0@lo:400: 00000100:00100000:0.0:1789672745.796803:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738345984:12345-0@lo:13: Request processed in 116us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672745.796811:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789672745.796842:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672745.796871:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738346624:0@lo:400: 00000100:00100000:3.0:1789672745.796897:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672745.796925:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789672745.796930:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738346240:0@lo:400: 00000100:00100000:3.0:1789672745.796952:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672745.796968:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738346752:0@lo:400: 00000100:00100000:3.0:1789672745.796985:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672745.797007:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738346496:0@lo:400: 00000100:00100000:3.0:1789672745.797026:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672745.797042:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789672745.797046:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738346368:0@lo:400: 00000100:00100000:3.0:1789672745.797063:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672745.797076:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738346880:0@lo:400: 00000100:00100000:3.0:1789672745.797093:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672745.797112:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738346240 00000100:00100000:3.0:1789672745.797122:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738346240 00000100:00100000:3.0:1789672745.797144:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738346752 00000100:00100000:3.0:1789672745.797147:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738346752 00000100:00100000:0.0:1789672745.797285:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738346624 00000100:00100000:0.0:1789672745.797291:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738346624 00000100:00100000:0.0:1789672745.797317:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738346368 00000100:00100000:0.0:1789672745.797321:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738346368 00000100:00100000:0.0:1789672745.797336:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789672745.797342:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738346624:12345-0@lo:400: 00000100:00100000:0.0:1789672745.797386:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738346624:12345-0@lo:400: Request processed in 44us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672745.797392:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789672745.797404:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789672745.797410:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738346368:12345-0@lo:400: 00000100:00100000:0.0:1789672745.797442:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738346368:12345-0@lo:400: Request processed in 33us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672745.797448:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789672745.798234:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789672745.798244:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738345856:12345-0@lo:13: 00002000:00000024:2.0:1789672745.798447:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672745.798509:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738345856:12345-0@lo:13: Request processed in 267us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672745.798517:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789672745.798548:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738346112 00000100:00100000:2.0:1789672745.798554:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738346112 00000100:00100000:2.0:1789672745.798603:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789672745.798610:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3635:x1876607738346112:12345-0@lo:400: 00000100:00100000:2.0:1789672745.798643:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3635:x1876607738346112:12345-0@lo:400: Request processed in 34us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672745.798649:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789672745.798832:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738346496 00000100:00100000:2.0:1789672745.798837:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738346496 00000100:00100000:2.0:1789672745.798855:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738346880 00000100:00100000:2.0:1789672745.798857:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738346880 00000100:00100000:2.0:1789672745.798873:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789672745.798888:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738346240:12345-0@lo:400: 00000100:00100000:2.0:1789672745.798918:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738346240:12345-0@lo:400: Request processed in 40us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672745.798924:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789672745.798936:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789672745.798941:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738346496:12345-0@lo:400: 00000100:00100000:2.0:1789672745.798960:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738346496:12345-0@lo:400: Request processed in 20us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672745.798965:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789672745.798974:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789672745.798979:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738346880:12345-0@lo:400: 00000100:00100000:2.0:1789672745.799015:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738346880:12345-0@lo:400: Request processed in 36us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672745.799021:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789672745.799076:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7dac2d80 x1876607738346240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672745.799090:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738346240:0@lo:400: 00000100:00100000:2.0:1789672745.799112:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738346112:0@lo:400: 00000100:00100000:2.0:1789672745.799122:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738346624:0@lo:400: 00000100:00100000:2.0:1789672745.799161:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738346368:0@lo:400: 00010000:00080000:2.0:1789672745.799172:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7dac0e00 x1876607738346880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672745.799180:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738346880:0@lo:400: 00010000:00080000:2.0:1789672745.799189:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7dac0000 x1876607738346496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672745.799197:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738346496:0@lo:400: 00000100:00100000:3.0:1789672745.799510:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789672745.799519:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738346752:12345-0@lo:400: 00000100:00100000:3.0:1789672745.799560:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738346752:12345-0@lo:400: Request processed in 44us (2574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672745.799566:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789672745.799948:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7dac0a80 x1876607738346752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672745.799959:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738346752:0@lo:400: 00010000:00080000:3.0:1789672745.800155:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7d938700 x1876607738345984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672745.800164:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789672745.800179:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738345984:0@lo:13: 00010000:00080000:3.0:1789672745.800189:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462eb800 x1876607738345856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672745.800199:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738345856:0@lo:13: 00000100:00080000:1.0:1789672745.800645:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789672745.800652:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789672745.800655:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789672746.184616:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672746.824100:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738347008:0@lo:41: 00000100:00100000:3.0:1789672746.824182:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672746.824899:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738347008 00000100:00100000:0.0:1789672746.824909:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738347008 00000100:00100000:0.0:1789672746.824965:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789672746.824975:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738347008:12345-0@lo:41: 00000004:00000024:0.0:1789672746.825007:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789672746.825068:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738347008:12345-0@lo:41: Request processed in 94us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672746.825075:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789672746.827338:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738347008:0@lo:41: 00010000:00010000:0.0:1789672747.204114:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789672747.205040:0:8958:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789672747.205303:0:8958:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789672747.844454:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672747.844485:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738347136:0@lo:41: 00000100:00100000:3.0:1789672747.844564:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672747.844637:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738347136 00000100:00100000:3.0:1789672747.844645:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738347136 00000100:00100000:3.0:1789672747.844721:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789672747.844731:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738347136:12345-0@lo:41: 00000004:00000024:3.0:1789672747.844909:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789672747.844984:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738347136:12345-0@lo:41: Request processed in 255us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672747.844992:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789672747.845042:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738347136:0@lo:41: 00010000:00010000:3.0:1789672748.230927:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789672748.252808:0:9006:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789672748.252819:0:9006:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1789672749.252889:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672750.281459:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672750.922149:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672750.922182:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738347264:0@lo:400: 00000100:00100000:0.0:1789672750.922272:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672750.922373:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738347392:0@lo:13: 00000100:00100000:0.0:1789672750.922402:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672750.922441:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738347392 00000100:00100000:0.0:1789672750.922449:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738347392 00000100:00100000:0.0:1789672750.922504:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789672750.922515:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738347392:12345-0@lo:13: 00002000:00000024:0.0:1789672750.922544:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672750.922587:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738347392:12345-0@lo:13: Request processed in 75us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672750.922594:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789672750.922615:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789672750.922646:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7d938e00 x1876607738347392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672750.922704:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738347392:0@lo:13: 00000100:00100000:3.0:1789672750.927185:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738347776:0@lo:400: 00000100:00100000:3.0:1789672750.927269:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672750.927313:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738348288:0@lo:400: 00000100:00100000:0.0:1789672750.927483:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738347520:0@lo:400: 00000100:00100000:0.0:1789672750.927518:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672750.927542:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738348032:0@lo:400: 00000100:00100000:0.0:1789672750.927585:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672750.927616:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789672750.927622:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738347904:0@lo:400: 00000100:00100000:0.0:1789672750.927646:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672750.927805:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738347904 00000100:00100000:0.0:1789672750.927815:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738347904 00000100:00100000:3.0:1789672750.928494:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672750.928534:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789672750.928543:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738347648:0@lo:400: 00000100:00100000:3.0:1789672750.928582:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672750.928599:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738348160:0@lo:400: 00000100:00100000:3.0:1789672750.928619:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672750.928646:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738347776 00000100:00100000:3.0:1789672750.928652:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738347776 00000100:00100000:0.0:1789672750.929398:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738347648 00000100:00100000:0.0:1789672750.929405:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738347648 00000100:00100000:0.0:1789672750.929439:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789672750.929451:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738347904:12345-0@lo:400: 00000100:00100000:0.0:1789672750.929523:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738347904:12345-0@lo:400: Request processed in 75us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672750.929530:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789672750.929548:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789672750.929554:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738347648:12345-0@lo:400: 00000100:00100000:0.0:1789672750.929585:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738347648:12345-0@lo:400: Request processed in 31us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672750.929590:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789672750.929628:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738347904:0@lo:400: 00000100:00100000:3.0:1789672750.930229:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738347520 00000100:00100000:3.0:1789672750.930235:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738347520 00000100:00100000:3.0:1789672750.930247:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738348032 00000100:00100000:3.0:1789672750.930249:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738348032 00000100:00100000:3.0:1789672750.930277:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738348160 00000100:00100000:3.0:1789672750.930280:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738348160 00000100:00100000:3.0:1789672750.930294:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789672750.930301:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738347776:12345-0@lo:400: 00000100:00100000:3.0:1789672750.930344:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738347776:12345-0@lo:400: Request processed in 44us (3076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672750.930350:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789672750.930375:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789672750.930380:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738347520:12345-0@lo:400: 00000100:00100000:3.0:1789672750.930424:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738347520:12345-0@lo:400: Request processed in 44us (2905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672750.930431:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789672750.930442:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789672750.930448:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738348032:12345-0@lo:400: 00000100:00100000:3.0:1789672750.930496:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738348032:12345-0@lo:400: Request processed in 47us (2909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672750.930502:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789672750.930514:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789672750.930520:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738348160:12345-0@lo:400: 00000100:00100000:3.0:1789672750.930546:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738348160:12345-0@lo:400: Request processed in 27us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672750.930551:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789672750.930579:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738348288 00000100:00100000:3.0:1789672750.930582:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738348288 00000100:00100000:3.0:1789672750.930612:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789672750.930618:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738348288:12345-0@lo:400: 00000100:00100000:3.0:1789672750.930646:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738348288:12345-0@lo:400: Request processed in 29us (2156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672750.930651:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789672750.931106:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789672750.931113:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789672750.931115:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672750.931589:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738347264 00000100:00100000:2.0:1789672750.931597:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738347264 00000100:00100000:2.0:1789672750.931644:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789672750.931651:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3635:x1876607738347264:12345-0@lo:400: 00000100:00100000:2.0:1789672750.931773:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3635:x1876607738347264:12345-0@lo:400: Request processed in 121us (9499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672750.931779:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789672750.932393:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738347264:0@lo:400: 00000100:00100000:3.0:1789672750.932832:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738348416:0@lo:13: 00000100:00100000:3.0:1789672750.935093:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789672750.935205:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfb46802a00 x1876607738347520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672750.935243:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738347520:0@lo:400: 00010000:00080000:3.0:1789672750.935259:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfb46800a80 x1876607738348032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672750.935267:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738348032:0@lo:400: 00000100:00100000:3.0:1789672750.935315:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738347648:0@lo:400: 00010000:00080000:3.0:1789672750.935330:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfb46800000 x1876607738348160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672750.935337:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738348160:0@lo:400: 00010000:00080000:3.0:1789672750.935353:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfb46803100 x1876607738347776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672750.935360:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738347776:0@lo:400: 00010000:00080000:3.0:1789672750.935370:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfb46802d80 x1876607738348288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672750.935378:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738348288:0@lo:400: 00000100:00100000:0.0:1789672750.936366:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738348416 00000100:00100000:0.0:1789672750.936381:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738348416 00000100:00100000:0.0:1789672750.936446:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789672750.936455:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738348416:12345-0@lo:13: 00002000:00000024:0.0:1789672750.936494:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672750.936576:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738348416:12345-0@lo:13: Request processed in 122us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672750.936583:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789672750.936627:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462eb800 x1876607738348416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672750.936644:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738348416:0@lo:13: 00010000:00010000:3.0:1789672751.299824:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672751.942267:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789672751.942308:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738348544:0@lo:41: 00000100:00100000:1.0:1789672751.942383:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672751.942569:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738348544 00000100:00100000:0.0:1789672751.942579:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738348544 00000100:00100000:0.0:1789672751.942636:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789672751.942646:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738348544:12345-0@lo:41: 00000004:00000024:0.0:1789672751.942702:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789672751.942769:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738348544:12345-0@lo:41: Request processed in 124us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672751.942776:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789672751.942988:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738348544:0@lo:41: 00010000:00010000:3.0:1789672752.324371:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672752.965638:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738348672:0@lo:41: 00000100:00100000:0.0:1789672752.965765:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672752.967781:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738348672 00000100:00100000:3.0:1789672752.967798:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738348672 00000100:00100000:3.0:1789672752.967872:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789672752.967886:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738348672:12345-0@lo:41: 00000004:00000024:3.0:1789672752.968162:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789672752.968257:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738348672:12345-0@lo:41: Request processed in 374us (2492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672752.968276:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789672752.968444:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738348672:0@lo:41: 00010000:00010000:2.0:1789672753.351285:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672754.373882:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672755.396857:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672756.036160:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738348928:0@lo:13: 00000100:00100000:1.0:1789672756.036237:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672756.036363:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738348928 00000100:00100000:2.0:1789672756.036372:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738348928 00000100:00100000:2.0:1789672756.036444:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789672756.036454:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738348928:12345-0@lo:13: 00002000:00000024:2.0:1789672756.036500:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672756.036555:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738348928:12345-0@lo:13: Request processed in 102us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672756.036562:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789672756.036612:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462e8a80 x1876607738348928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672756.036642:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738348928:0@lo:13: 00000100:00080000:1.0:1789672756.036731:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672756.037149:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738348800:0@lo:13: 00000100:00100000:3.0:1789672756.037190:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672756.037246:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738348800 00000100:00100000:3.0:1789672756.037251:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738348800 00000100:00100000:3.0:1789672756.037285:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789672756.037292:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738348800:12345-0@lo:13: 00002000:00000024:3.0:1789672756.037306:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672756.037340:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738348800:12345-0@lo:13: Request processed in 47us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672756.037346:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789672756.037361:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789672756.037377:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7d93ad80 x1876607738348800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672756.037391:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738348800:0@lo:13: 00000100:00100000:0.0:1789672756.037696:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738349056:0@lo:400: 00000100:00100000:0.0:1789672756.037738:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672756.037766:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738349568:0@lo:400: 00000100:00100000:0.0:1789672756.037813:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672756.037836:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789672756.037842:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738349440:0@lo:400: 00000100:00100000:0.0:1789672756.037868:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672756.037896:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738349056 00000100:00100000:0.0:1789672756.037915:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738349056 00000100:00100000:0.0:1789672756.037945:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789672756.037952:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3638:x1876607738349056:12345-0@lo:400: 00000100:00100000:0.0:1789672756.037993:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3638:x1876607738349056:12345-0@lo:400: Request processed in 41us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672756.038000:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789672756.038036:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738349056:0@lo:400: 00000100:00100000:3.0:1789672756.038377:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738349440 00000100:00100000:3.0:1789672756.038384:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738349440 00000100:00100000:3.0:1789672756.038541:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789672756.038549:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738349440:12345-0@lo:400: 00000100:00100000:3.0:1789672756.038604:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738349440:12345-0@lo:400: Request processed in 57us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672756.038611:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789672756.038868:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462dd500 x1876607738349440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672756.038881:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738349440:0@lo:400: 00000100:00100000:2.0:1789672756.038975:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738349568 00000100:00100000:2.0:1789672756.038980:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738349568 00000100:00100000:2.0:1789672756.039010:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789672756.039018:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738349568:12345-0@lo:400: 00000100:00100000:2.0:1789672756.039069:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738349568:12345-0@lo:400: Request processed in 52us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672756.039075:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789672756.039147:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738349568:0@lo:400: 00000100:00100000:2.0:1789672756.039793:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738349184:0@lo:400: 00000100:00100000:2.0:1789672756.039851:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672756.039886:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738349696:0@lo:400: 00000100:00100000:2.0:1789672756.039909:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672756.040094:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789672756.040102:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738349312:0@lo:400: 00000100:00100000:2.0:1789672756.040128:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672756.040150:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738349824:0@lo:400: 00000100:00100000:2.0:1789672756.040170:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672756.040434:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738349184 00000100:00100000:1.0:1789672756.040442:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738349184 00000100:00100000:1.0:1789672756.040478:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738349696 00000100:00100000:1.0:1789672756.040480:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738349696 00000100:00100000:1.0:1789672756.040516:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738349824 00000100:00100000:1.0:1789672756.040520:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738349824 00000100:00100000:1.0:1789672756.040538:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789672756.040547:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738349184:12345-0@lo:400: 00000100:00080000:2.0:1789672756.040693:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789672756.040698:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672756.040753:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738349184:12345-0@lo:400: Request processed in 61us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672756.040764:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789672756.040940:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789672756.040948:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738349696:12345-0@lo:400: 00000100:00100000:1.0:1789672756.040982:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738349696:12345-0@lo:400: Request processed in 36us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672756.040988:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789672756.041017:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789672756.041023:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738349824:12345-0@lo:400: 00000100:00100000:1.0:1789672756.041053:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738349824:12345-0@lo:400: Request processed in 30us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672756.041059:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789672756.041077:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738349312 00000100:00100000:1.0:1789672756.041082:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738349312 00000100:00100000:1.0:1789672756.041114:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789672756.041121:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738349312:12345-0@lo:400: 00000100:00100000:1.0:1789672756.041155:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738349312:12345-0@lo:400: Request processed in 35us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672756.041161:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789672756.041203:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738349312:0@lo:400: 00010000:00080000:1.0:1789672756.041223:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462ded80 x1876607738349824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672756.041234:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738349824:0@lo:400: 00010000:00080000:1.0:1789672756.041247:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462ddf80 x1876607738349184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672756.041255:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738349184:0@lo:400: 00010000:00080000:1.0:1789672756.041269:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462dea00 x1876607738349696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672756.041277:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738349696:0@lo:400: 00010000:00010000:3.0:1789672756.430059:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672757.064503:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789672757.064545:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738349952:0@lo:41: 00000100:00100000:0.0:1789672757.066563:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672757.070913:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738349952 00000100:00100000:2.0:1789672757.071064:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738349952 00000100:00100000:2.0:1789672757.071181:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789672757.071192:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738349952:12345-0@lo:41: 00000004:00000024:2.0:1789672757.071242:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789672757.071347:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738349952:12345-0@lo:41: Request processed in 156us (4794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672757.071355:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789672757.071445:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738349952:0@lo:41: 00010000:00010000:0.0:1789672757.448700:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672758.085992:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672758.086021:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738350080:0@lo:41: 00000100:00100000:0.0:1789672758.086111:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672758.086186:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738350080 00000100:00100000:0.0:1789672758.086195:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738350080 00000100:00100000:0.0:1789672758.086250:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789672758.086260:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738350080:12345-0@lo:41: 00000004:00000024:0.0:1789672758.086295:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789672758.086344:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738350080:12345-0@lo:41: Request processed in 84us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672758.086351:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789672758.086394:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738350080:0@lo:41: 00010000:00010000:3.0:1789672758.468062:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672759.491841:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789672759.927528:0:9505:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789672759.927532:0:9505:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789672759.927533:0:9505:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789672759.927810:0:9505:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cfb4676b800 00000020:01000004:2.0:1789672759.927825:0:9505:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789672759.927838:0:9505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789672759.927852:0:9505:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cfc7c67b380) 00000020:00000080:2.0:1789672759.927867:0:9505:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789672759.983402:0:9505:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789672759.983460:0:9505:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1789672760.038048:0:9505:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789672760.038654:0:9505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789672760.038760:0:9505:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789672760.038773:0:9505:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6c78c4f8c9964eb2 00000020:01000004:2.0:1789672760.038780:0:9505:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789672760.038856:0:9505:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.150@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789672760.038860:0:9505:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789672760.038867:0:9505:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789672760.038909:0:9505:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789672760.038913:0:9505:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789672760.098870:0:9505:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789672760.098913:0:9505:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.150@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789672760.098917:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789672760.098920:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789672760.098925:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672760.098926:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672760.098927:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672760.098928:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672760.098930:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672760.099327:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789672760.099329:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789672760.099331:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672760.099332:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789672760.099335:0:9505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789672760.099338:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789672760.099339:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789672760.099340:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672760.099341:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789672760.099342:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672760.099343:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672760.099344:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672760.099345:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789672760.099346:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789672760.099347:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672760.099348:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789672760.099390:0:9505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789672760.099410:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738350208:0@lo:253: 00000100:00100000:2.0:1789672760.099480:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.099615:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b480 going to sleep for 11 seconds 00000100:00100000:0.0:1789672760.099832:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738350208 00000100:00100000:0.0:1789672760.099842:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738350208 00000100:00100000:0.0:1789672760.099930:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789672760.099960:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:9505:x1876607738350208:12345-0@lo:253: 20000000:01000000:0.0:1789672760.099991:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789672760.099995:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789672760.099999:0:6506:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789672760.100002:0:6506:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789672760.100444:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789672760.100602:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1789672760.100617:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789672760.100635:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1789672760.100641:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789672760.100655:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1789672760.100772:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1789672760.100858:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1789672760.100875:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.150@tcp 20000000:01000000:0.0:1789672760.100878:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:0.0:1789672760.100893:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1789672760.100899:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789672760.100913:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1789672760.100919:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:0.0:1789672760.101162:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1789672760.101175:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789672760.101193:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1789672760.101210:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1789672760.101287:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1789672760.101378:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.150@tcp 20000000:01000000:0.0:1789672760.101381:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:0.0:1789672760.101401:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1789672760.101408:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789672760.101422:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1789672760.101427:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:0.0:1789672760.101440:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1789672760.101458:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789672760.101474:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1789672760.101491:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1789672760.102887:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1789672760.102918:0:6506:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.150@tcp 20000000:01000000:0.0:1789672760.102920:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.150@tcp (null) (null) (null) 00000040:00080000:0.0:1789672760.103132:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1789672760.103141:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789672760.103157:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1789672760.103163:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.150@tcp (null) (null) 00000040:00080000:0.0:1789672760.103175:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1789672760.103183:0:6506:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789672760.103194:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1789672760.103207:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1789672760.103221:0:6506:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789672760.103223:0:6506:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789672760.103227:0:6506:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789672760.103272:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789672760.103275:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789672760.103898:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1789672760.104015:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1789672760.104103:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789672760.104414:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789672760.104437:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1789672760.104451:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1789672760.104461:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789672760.104464:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789672760.104957:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1789672760.105329:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1789672760.105351:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1789672760.105366:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1789672760.105374:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789672760.105376:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789672760.107092:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1789672760.107154:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1789672760.107173:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1789672760.107652:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1789672760.107909:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1789672760.107928:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1789672760.110201:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789672760.110209:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789672760.115581:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1789672760.115653:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1789672760.115866:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1789672760.116211:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1789672760.116239:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1789672760.116255:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1789672760.116277:0:6506:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789672760.116280:0:6506:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789672760.117416:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1789672760.117451:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1789672760.117470:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1789672760.117720:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1789672760.117743:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1789672760.117759:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:3.0:1789672760.117775:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789672760.117797:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9964eb9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.117819:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964da8 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.117828:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964dd2 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.117835:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d886600/0x6c78c4f8c9964e18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e11 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.117842:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e2d expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.117848:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc52435400/0x6c78c4f8c9964e5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e57 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.117855:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc61609600/0x6c78c4f8c9964e7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e73 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.117862:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc427c3000/0x6c78c4f8c9964ea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e9d expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.117870:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9964eb9 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.117928:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc427c3000/0x6c78c4f8c9964ea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964e9d expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.117960:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc427c3000/0x6c78c4f8c9964ea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e9d expref: 21 pid: 6506 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672760.117978:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46803100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738350336:0@lo:104: 00000100:00100000:3.0:1789672760.118072:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672760.118147:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc61609600/0x6c78c4f8c9964e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964e73 expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.118155:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc61609600/0x6c78c4f8c9964e7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e73 expref: 21 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672760.118163:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738350464:0@lo:104: 00000100:00100000:3.0:1789672760.118184:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672760.118211:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc52435400/0x6c78c4f8c9964e5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964e57 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.118219:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc52435400/0x6c78c4f8c9964e5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e57 expref: 21 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672760.118227:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46802a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738350592:0@lo:104: 00000100:00100000:3.0:1789672760.118246:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672760.118262:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964e2d expref: 21 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.118270:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964e34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e2d expref: 21 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672760.118290:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738350720:0@lo:104: 00000100:00100000:3.0:1789672760.118520:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672760.118539:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d886600/0x6c78c4f8c9964e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964e11 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.118548:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc7d886600/0x6c78c4f8c9964e18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e11 expref: 21 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672760.118566:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738350848:0@lo:104: 00000100:00100000:3.0:1789672760.118590:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672760.118609:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964dd2 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.118616:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964dd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964dd2 expref: 21 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672760.118624:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46803800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738350976:0@lo:104: 00000100:00100000:3.0:1789672760.118648:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672760.118702:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964da8 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.118710:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964daf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964da8 expref: 21 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672760.118718:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738351104:0@lo:104: 00000100:00100000:3.0:1789672760.118739:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4a65b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789672760.122716:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789672760.122777:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672760.122807:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738350336 00000100:00100000:1.0:1789672760.122818:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738350336 00000100:00100000:1.0:1789672760.122873:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738350464 00000100:00100000:1.0:1789672760.122877:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738350464 00000100:00100000:1.0:1789672760.122890:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738350592 00000100:00100000:1.0:1789672760.122893:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738350592 00000100:00100000:1.0:1789672760.122905:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738350720 00000100:00100000:1.0:1789672760.122908:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738350720 00000100:00100000:1.0:1789672760.122918:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738350848 00000100:00100000:1.0:1789672760.122920:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738350848 00000100:00100000:1.0:1789672760.122929:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738350976 00000100:00100000:1.0:1789672760.122945:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738350976 00000100:00100000:1.0:1789672760.122958:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738351104 00000100:00100000:1.0:1789672760.122960:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738351104 00000100:00100000:1.0:1789672760.122971:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789672760.122982:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+9:6506:x1876607738350336:12345-0@lo:104: 00010000:00010000:1.0:1789672760.123004:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964e9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964ea4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.123214:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789672760.123221:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46800000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+9:6506:x1876607738350336:12345-0@lo:104: Request processed in 242us (5150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.123229:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789672760.123266:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789672760.123273:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+8:6506:x1876607738350464:12345-0@lo:104: 00010000:00010000:1.0:1789672760.123282:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc61609800/0x6c78c4f8c9964e73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964e7a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.123398:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789672760.123420:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+8:6506:x1876607738350464:12345-0@lo:104: Request processed in 148us (5235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.123427:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789672760.123443:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789672760.123450:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+7:6506:x1876607738350592:12345-0@lo:104: 00010000:00010000:1.0:1789672760.123459:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc52435800/0x6c78c4f8c9964e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.123488:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789672760.123493:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+7:6506:x1876607738350592:12345-0@lo:104: Request processed in 44us (5246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.123498:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789672760.123511:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789672760.123518:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46800700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+6:6506:x1876607738350720:12345-0@lo:104: 00010000:00010000:1.0:1789672760.123526:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2a00/0x6c78c4f8c9964e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964e34 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.123553:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789672760.123568:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46800700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+6:6506:x1876607738350720:12345-0@lo:104: Request processed in 41us (5038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.123574:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789672760.123601:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789672760.123607:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:6506:x1876607738350848:12345-0@lo:104: 00010000:00010000:1.0:1789672760.123614:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc52434200/0x6c78c4f8c9964e11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964e18 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.123697:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789672760.123708:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:6506:x1876607738350848:12345-0@lo:104: Request processed in 101us (5118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.123714:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789672760.123729:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789672760.123735:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb41a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:6506:x1876607738350976:12345-0@lo:104: 00010000:00010000:1.0:1789672760.123744:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964dd9 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.123775:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1789672760.123780:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb41a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:6506:x1876607738350976:12345-0@lo:104: Request processed in 46us (5132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.123785:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789672760.123838:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789672760.123845:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6506:x1876607738351104:12345-0@lo:104: 00010000:00010000:1.0:1789672760.123853:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964da8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964daf expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.123880:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1789672760.123885:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6506:x1876607738351104:12345-0@lo:104: Request processed in 42us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.123890:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789672760.123914:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1789672760.123922:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964e9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964ea4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.123931:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc427c3400 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:1.0:1789672760.125178:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964e9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964ea4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125208:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964e9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964ea4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672760.125216:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964e9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964ea4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672760.125221:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672760.125271:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964e9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964ea4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125279:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789672760.125439:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46803100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738350336:0@lo:104: 00000100:00100000:3.0:1789672760.125450:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738350464:0@lo:104: 00000100:00100000:3.0:1789672760.125466:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46802a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738350592:0@lo:104: 00000100:00100000:3.0:1789672760.125474:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738350720:0@lo:104: 00000100:00100000:3.0:1789672760.125481:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738350848:0@lo:104: 00000100:00100000:3.0:1789672760.125488:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46803800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738350976:0@lo:104: 00000100:00100000:3.0:1789672760.125495:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6506:1876607738351104:0@lo:104: 00010000:00010000:3.0:1789672760.125528:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9964eb9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125589:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964e9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964ea4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125598:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3400/0x6c78c4f8c9964e9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964ea4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125611:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789672760.125615:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc61609800/0x6c78c4f8c9964e73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964e7a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125621:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61609800 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:1.0:1789672760.125624:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61609800/0x6c78c4f8c9964e73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964e7a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125631:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc61609800/0x6c78c4f8c9964e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964e7a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672760.125638:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61609800/0x6c78c4f8c9964e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964e7a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672760.125648:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672760.125683:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc61609800/0x6c78c4f8c9964e73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e7a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125689:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672760.125695:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc61609800/0x6c78c4f8c9964e73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e7a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125701:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc61609800/0x6c78c4f8c9964e73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e7a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125711:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789672760.125714:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc52435800/0x6c78c4f8c9964e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125720:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435800 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:1.0:1789672760.125723:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52435800/0x6c78c4f8c9964e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125729:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc52435800/0x6c78c4f8c9964e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672760.125735:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52435800/0x6c78c4f8c9964e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672760.125740:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672760.125750:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc52435800/0x6c78c4f8c9964e57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125755:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672760.125775:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc52435800/0x6c78c4f8c9964e57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125781:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc52435800/0x6c78c4f8c9964e57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e5e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125790:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789672760.125793:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2a00/0x6c78c4f8c9964e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964e34 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125799:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc427c2a00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:1.0:1789672760.125801:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2a00/0x6c78c4f8c9964e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964e34 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125808:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2a00/0x6c78c4f8c9964e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964e34 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672760.125814:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2a00/0x6c78c4f8c9964e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964e34 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672760.125819:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672760.125832:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2a00/0x6c78c4f8c9964e2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e34 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125837:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672760.125842:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2a00/0x6c78c4f8c9964e2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e34 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125848:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2a00/0x6c78c4f8c9964e2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e34 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125856:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789672760.125865:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc52434200/0x6c78c4f8c9964e11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964e18 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125870:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434200 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:1.0:1789672760.125873:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52434200/0x6c78c4f8c9964e11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964e18 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125880:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc52434200/0x6c78c4f8c9964e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964e18 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672760.125887:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52434200/0x6c78c4f8c9964e11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964e18 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672760.125903:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672760.125916:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc52434200/0x6c78c4f8c9964e11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e18 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125921:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672760.125925:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc52434200/0x6c78c4f8c9964e11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e18 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125931:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc52434200/0x6c78c4f8c9964e11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e18 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125939:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789672760.125942:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964dd9 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125948:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61609e00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:1.0:1789672760.125951:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964dd9 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125966:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964dd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964dd9 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672760.125972:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964dd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964dd9 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672760.125977:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672760.125986:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964dd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964dd9 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.125991:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672760.125995:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964dd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964dd9 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.126001:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9964dd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964dd9 expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.126008:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672760.126011:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964da8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964daf expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.126016:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61608e00 already unused, calling callback (ffffffffc127cc20) 00000100:00100000:3.0:1789672760.126229:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738351360:0@lo:103: 00000100:00100000:3.0:1789672760.126287:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672760.126338:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738351872:0@lo:103: 00000100:00100000:3.0:1789672760.126371:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672760.126395:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789672760.126400:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738351232:0@lo:103: 00000100:00100000:3.0:1789672760.126416:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672760.126431:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738351744:0@lo:103: 00000100:00100000:3.0:1789672760.126452:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672760.126577:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738351360 00000100:00100000:0.0:1789672760.126592:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738351360 00010000:00010000:0.0:1789672760.126621:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc61609600/0x6c78c4f8c9964e7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e73 expref: 22 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672760.126640:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738351872 00000100:00100000:0.0:1789672760.126643:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738351872 00010000:00010000:0.0:1789672760.126651:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964dd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964dd2 expref: 23 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672760.126690:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738351232 00000100:00100000:0.0:1789672760.126693:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738351232 00010000:00010000:0.0:1789672760.126706:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc427c3000/0x6c78c4f8c9964ea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e9d expref: 24 pid: 6506 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672760.126716:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738351744 00000100:00100000:0.0:1789672760.126719:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738351744 00010000:00010000:0.0:1789672760.126729:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d886600/0x6c78c4f8c9964e18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e11 expref: 25 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672760.126742:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789672760.126749:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+25:3636:x1876607738351360:12345-0@lo:103: 00010000:00010000:0.0:1789672760.126763:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672760.126768:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc61609600/0x6c78c4f8c9964e7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e73 expref: 25 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.126780:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc61609600/0x6c78c4f8c9964e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e73 expref: 25 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.126795:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc61609600/0x6c78c4f8c9964e7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964e73 expref: 25 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.126808:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672760.126850:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3636:x1876607738351360:12345-0@lo:103: Request processed in 102us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672760.126857:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789672760.126886:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789672760.126891:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:3636:x1876607738351872:12345-0@lo:103: 00010000:00010000:0.0:1789672760.126898:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672760.126902:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964dd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964dd2 expref: 23 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.126911:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964dd2 expref: 23 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.126922:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc61609000/0x6c78c4f8c9964dd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964dd2 expref: 23 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.126931:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672760.126961:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:3636:x1876607738351872:12345-0@lo:103: Request processed in 70us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672760.126967:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789672760.126978:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789672760.126983:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3636:x1876607738351232:12345-0@lo:103: 00010000:00010000:0.0:1789672760.126989:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672760.126993:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc427c3000/0x6c78c4f8c9964ea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e9d expref: 21 pid: 6506 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.127002:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc427c3000/0x6c78c4f8c9964ea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e9d expref: 21 pid: 6506 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.127011:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc427c3000/0x6c78c4f8c9964ea4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964e9d expref: 21 pid: 6506 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.127034:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672760.127053:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:3636:x1876607738351232:12345-0@lo:103: Request processed in 70us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672760.127059:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789672760.127071:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789672760.127077:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc65c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:3636:x1876607738351744:12345-0@lo:103: 00010000:00010000:0.0:1789672760.127083:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672760.127087:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d886600/0x6c78c4f8c9964e18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e11 expref: 19 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.127095:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d886600/0x6c78c4f8c9964e18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e11 expref: 19 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.127105:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d886600/0x6c78c4f8c9964e18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964e11 expref: 19 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.127113:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672760.127131:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc65c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:3636:x1876607738351744:12345-0@lo:103: Request processed in 54us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672760.127136:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 10000000:00010000:1.0:1789672760.127548:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964da8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964daf expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.127571:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964daf expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672760.127579:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964daf expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672760.127592:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672760.127618:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964da8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964daf expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.127623:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672760.127631:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964da8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964daf expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.127637:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964da8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964daf expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.127651:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672760.127653:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672760.127654:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672760.127684:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672760.127708:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738351488:0@lo:103: 00000100:00100000:1.0:1789672760.127741:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672760.127767:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738352000:0@lo:103: 00000100:00100000:1.0:1789672760.127787:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672760.127801:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789672760.127807:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738351616:0@lo:103: 00000100:00100000:1.0:1789672760.127826:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672760.127853:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738351488 00000100:00100000:1.0:1789672760.127859:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738351488 00010000:00010000:1.0:1789672760.127883:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc52435400/0x6c78c4f8c9964e5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e57 expref: 18 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672760.127900:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738352000 00000100:00100000:1.0:1789672760.127908:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738352000 00010000:00010000:1.0:1789672760.127918:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964daf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964da8 expref: 19 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672760.127927:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738351616 00000100:00100000:1.0:1789672760.127930:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738351616 00010000:00010000:1.0:1789672760.131839:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964e34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e2d expref: 20 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672760.131890:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789672760.131902:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:3637:x1876607738351488:12345-0@lo:103: 00010000:00010000:1.0:1789672760.131920:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672760.131928:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc52435400/0x6c78c4f8c9964e5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e57 expref: 20 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672760.132078:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738351232:0@lo:103: 00000100:00100000:3.0:1789672760.132092:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738351744:0@lo:103: 00000100:00100000:3.0:1789672760.132101:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738351360:0@lo:103: 00000100:00100000:3.0:1789672760.132110:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738351872:0@lo:103: 00010000:00010000:1.0:1789672760.132220:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc52435400/0x6c78c4f8c9964e5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e57 expref: 20 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.132241:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc52435400/0x6c78c4f8c9964e5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964e57 expref: 20 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.132261:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672760.132583:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:3637:x1876607738351488:12345-0@lo:103: Request processed in 682us (4839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.132593:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789672760.132621:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789672760.132630:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:3637:x1876607738352000:12345-0@lo:103: 00010000:00010000:1.0:1789672760.132641:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672760.132647:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964daf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964da8 expref: 18 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.132711:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964da8 expref: 18 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.132723:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964daf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964da8 expref: 18 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.132733:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672760.132760:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:3637:x1876607738352000:12345-0@lo:103: Request processed in 132us (4972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.132766:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789672760.132786:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789672760.132792:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:3637:x1876607738351616:12345-0@lo:103: 00010000:00010000:1.0:1789672760.132802:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672760.132806:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964e34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e2d expref: 16 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.132816:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e2d expref: 16 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.132825:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc427c3200/0x6c78c4f8c9964e34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964e2d expref: 16 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.132841:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9964eb9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.132850:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9964eb9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.132870:0:7920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9964eb9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.132884:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9964eb9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.132891:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9964eb9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.132899:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9964eb9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.132906:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887400 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789672760.132911:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9964eb9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.132920:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9964eb9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672760.133215:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738351488:0@lo:103: 00000100:00100000:3.0:1789672760.133239:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738352000:0@lo:103: 00010000:00010000:1.0:1789672760.135484:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9964eb9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.135520:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672760.135637:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:3637:x1876607738351616:12345-0@lo:103: Request processed in 2840us (7804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.135649:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789672760.135759:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738351616:0@lo:103: 00010000:00010000:0.0:1789672760.136085:0:6506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9964eb9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.136096:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9964eb9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.136102:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9964eb9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789672760.136139:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789672760.141899:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:9505:x1876607738350208:12345-0@lo:253: Request processed in 41931us (42407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672760.141916:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789672760.142036:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738350208:0@lo:253: 10000000:01000000:2.0:1789672760.142055:0:9505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789672760.142059:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789672760.142060:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789672760.142062:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789672760.142063:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789672760.142065:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789672760.142066:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789672760.142067:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789672760.142069:0:9505:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789672760.142071:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789672760.142072:0:9505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789672760.142096:0:9505:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfb4676b800 from lustre-OST0001 10000000:01000000:2.0:1789672760.142133:0:9505:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789672760.142136:0:9505:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789672760.142146:0:9505:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cfc499cb380 local copy 10000000:01000000:2.0:1789672760.142150:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789672760.142192:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1800/0x6c78c4f8c9964ec0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.142205:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1800/0x6c78c4f8c9964ec0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.142217:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1800/0x6c78c4f8c9964ec0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672760.142235:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738352128:0@lo:101: 00000100:00100000:2.0:1789672760.142274:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.142344:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672760.142465:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738352128 00000100:00100000:0.0:1789672760.142473:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738352128 00000100:00100000:0.0:1789672760.142525:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789672760.142535:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+14:9505:x1876607738352128:12345-0@lo:101: 00010000:00010000:0.0:1789672760.142549:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672760.142576:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c9964ec7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964ec0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.142601:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c9964ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964ec0 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.142614:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c9964ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964ec0 expref: 15 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.142623:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435000, rc 0) 00000100:00100000:0.0:1789672760.142699:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:9505:x1876607738352128:12345-0@lo:101: Request processed in 165us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672760.142706:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789672760.143443:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738352128:0@lo:101: 00010000:00010000:2.0:1789672760.143468:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1800/0x6c78c4f8c9964ec0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6c78c4f8c9964ec7 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.143481:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1800/0x6c78c4f8c9964ec0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6c78c4f8c9964ec7 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672760.143633:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738352256:0@lo:501: 00000100:00100000:2.0:1789672760.143714:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.143753:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672760.143835:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738352256 00000100:00100000:0.0:1789672760.143842:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738352256 00000100:00100000:0.0:1789672760.143888:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789672760.143899:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:9505:x1876607738352256:12345-0@lo:501: 00000100:00100000:0.0:1789672760.143985:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:9505:x1876607738352256:12345-0@lo:501: Request processed in 89us (270us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789672760.144007:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789672760.144502:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738352256:0@lo:501: 10000000:01000000:3.0:1789672760.144531:0:9505:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789672760.144595:0:9505:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789672760.144604:0:9505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1800/0x6c78c4f8c9964ec0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6c78c4f8c9964ec7 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.144614:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1800/0x6c78c4f8c9964ec0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6c78c4f8c9964ec7 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.144620:0:9505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1800/0x6c78c4f8c9964ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6c78c4f8c9964ec7 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.144706:0:9505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789672760.144739:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfb4676b800 10000000:01000000:3.0:1789672760.144743:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789672760.144749:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789672760.144753:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789672760.144757:0:9505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789672760.144761:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789672760.144786:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c9964ece lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.144793:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c9964ece lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.144803:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c9964ece lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672760.144831:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738352384:0@lo:101: 00000100:00100000:3.0:1789672760.144865:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672760.144889:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc47ca2300 going to sleep for 11 seconds 00000100:00100000:2.0:1789672760.146631:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738352384 00000100:00100000:2.0:1789672760.146645:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738352384 00000100:00100000:2.0:1789672760.146730:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789672760.146742:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:9505:x1876607738352384:12345-0@lo:101: 00010000:00010000:2.0:1789672760.146765:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672760.146787:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9964ed5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964ece expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.146818:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9964ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964ece expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.146830:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9964ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964ece expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.146840:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a0000, rc 0) 00000100:00100000:2.0:1789672760.146907:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738352384:12345-0@lo:101: Request processed in 167us (2041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672760.146914:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789672760.147414:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738352384:0@lo:101: 00010000:00010000:3.0:1789672760.147439:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c9964ece lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964ed5 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.147448:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c9964ece lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964ed5 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672760.147552:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738352512:0@lo:501: 00000100:00100000:3.0:1789672760.147601:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672760.147637:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc47ca2300 going to sleep for 11 seconds 00000100:00100000:2.0:1789672760.147793:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738352512 00000100:00100000:2.0:1789672760.147800:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738352512 00000100:00100000:2.0:1789672760.147828:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789672760.147835:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738352512:12345-0@lo:501: 00000100:00100000:2.0:1789672760.147960:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738352512:12345-0@lo:501: Request processed in 124us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672760.147967:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789672760.148031:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738352512:0@lo:501: 00000100:00100000:0.0:1789672760.148056:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738352640:0@lo:503: 00000100:00100000:0.0:1789672760.148099:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672760.148126:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc499189c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672760.148501:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738352640 00000100:00100000:2.0:1789672760.148506:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738352640 00000100:00100000:2.0:1789672760.148539:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789672760.148548:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738352640:12345-0@lo:503: 00000100:00100000:2.0:1789672760.148649:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738352640:12345-0@lo:503: Request processed in 103us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672760.148655:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789672760.148795:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738352640:0@lo:503: 00000040:00080000:0.0:1789672760.149102:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789672760.149175:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738352768:0@lo:502: 00000100:00100000:0.0:1789672760.149217:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672760.149241:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc499189c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672760.149316:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738352768 00000100:00100000:3.0:1789672760.149322:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738352768 00000100:00100000:3.0:1789672760.149356:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789672760.149365:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738352768:12345-0@lo:502: 00000100:00100000:3.0:1789672760.149442:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738352768:12345-0@lo:502: Request processed in 79us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672760.149449:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789672760.149771:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738352768:0@lo:502: 00000040:00080000:0.0:1789672760.150032:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789672760.150061:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789672760.150074:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789672760.150087:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789672760.150099:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789672760.150113:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789672760.150140:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738352896:0@lo:502: 00000100:00100000:0.0:1789672760.150179:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672760.150202:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc499189c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672760.150428:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738352896 00000100:00100000:3.0:1789672760.150435:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738352896 00000100:00100000:3.0:1789672760.150476:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789672760.150485:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738352896:12345-0@lo:502: 00000100:00100000:3.0:1789672760.150593:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738352896:12345-0@lo:502: Request processed in 109us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672760.150610:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00010000:1.0:1789672760.150837:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672760.150847:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1800/0x6c78c4f8c9964ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6c78c4f8c9964ec7 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.150857:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a1800 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:1.0:1789672760.150867:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1800/0x6c78c4f8c9964ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6c78c4f8c9964ec7 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.150878:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1800/0x6c78c4f8c9964ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x6c78c4f8c9964ec7 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672760.150886:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1800/0x6c78c4f8c9964ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x6c78c4f8c9964ec7 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672760.150892:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789672760.151268:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738352896:0@lo:502: 00000040:00080000:0.0:1789672760.151354:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789672760.151367:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00010000:00010000:0.0:1789672760.151551:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1800/0x6c78c4f8c9964ec0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6c78c4f8c9964ec7 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.151581:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672760.151615:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1800/0x6c78c4f8c9964ec0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6c78c4f8c9964ec7 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.151623:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1800/0x6c78c4f8c9964ec0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6c78c4f8c9964ec7 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.151636:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672760.151638:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672760.151640:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672760.151767:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738353024:0@lo:103: 00000100:00100000:2.0:1789672760.151815:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672760.152137:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738353024 00000100:00100000:0.0:1789672760.152144:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738353024 00000100:00100000:0.0:1789672760.152196:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789672760.152205:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:3638:x1876607738353024:12345-0@lo:103: 00010000:00010000:0.0:1789672760.152216:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672760.152233:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c9964ec7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c9964ec0 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.152247:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672760.152283:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:3638:x1876607738353024:12345-0@lo:103: Request processed in 79us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672760.152289:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789672760.152334:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738353024:0@lo:103: 00000020:01000000:2.0:1789672760.152654:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789672760.152698:0:9517:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789672760.152705:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672760.152707:0:9517:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789672760.152714:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789672760.152732:0:9517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cfc7c67cd40) 00000020:00000080:2.0:1789672760.152761:0:9517:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789672760.152768:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789672760.152839:0:9517:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfb4676b800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789672760.152849:0:9517:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789672760.152856:0:9517:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6c78c4f8c9964ee3 00010000:00010000:2.0:1789672760.166416:0:9517:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1789672760.167241:0:9517:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789672760.178114:0:9517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789672760.179409:0:9517:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789672760.185760:0:9517:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1789672760.186049:0:9517:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1789672760.200876:0:9517:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1789672760.205485:0:9517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789672760.205503:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672760.207027:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672760.207029:0:9517:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789672760.207039:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672760.207044:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672760.207045:0:9517:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789672760.207049:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789672760.207051:0:9517:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789672760.207075:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672760.207077:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672760.207078:0:9517:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789672760.207081:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789672760.210970:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789672760.211047:0:9505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789672760.211082:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c9964ece lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964ed5 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.211099:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c9964ece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964ed5 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672760.211109:0:9505:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfb4676b800 from 1 10000000:01000000:2.0:1789672760.211111:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789672760.211160:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0a00/0x6c78c4f8c9964eea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.211169:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0a00/0x6c78c4f8c9964eea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.211180:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0a00/0x6c78c4f8c9964eea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672760.211211:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738353152:0@lo:101: 00000100:00100000:2.0:1789672760.211282:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.211344:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789672760.212693:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738353152 00000100:00100000:0.0:1789672760.212719:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738353152 00000100:00100000:0.0:1789672760.212902:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789672760.212914:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:9505:x1876607738353152:12345-0@lo:101: 00010000:00010000:0.0:1789672760.212945:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672760.212964:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c9964ef1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964eea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.212991:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c9964ef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964eea expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.213002:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c9964ef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964eea expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.213010:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435000, rc 0) 00000100:00100000:0.0:1789672760.213070:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738353152:12345-0@lo:101: Request processed in 159us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672760.213076:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789672760.213143:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738353152:0@lo:101: 00010000:00010000:0.0:1789672760.213159:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0a00/0x6c78c4f8c9964eea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964ef1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.213169:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0a00/0x6c78c4f8c9964eea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964ef1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672760.214508:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738353280:0@lo:501: 00000100:00100000:0.0:1789672760.214576:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672760.214625:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc49918540 going to sleep for 11 seconds 00000100:00100000:3.0:1789672760.216166:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738353280 00000100:00100000:3.0:1789672760.216178:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738353280 00000100:00100000:3.0:1789672760.216272:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789672760.216282:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738353280:12345-0@lo:501: 00000100:00100000:3.0:1789672760.216434:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738353280:12345-0@lo:501: Request processed in 152us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672760.216441:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789672760.217457:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738353280:0@lo:501: 00000100:00100000:0.0:1789672760.217513:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738353408:0@lo:503: 00000100:00100000:0.0:1789672760.217581:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672760.217633:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc49918540 going to sleep for 11 seconds 00000100:00100000:3.0:1789672760.217958:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738353408 00000100:00100000:3.0:1789672760.217965:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738353408 00000100:00100000:0.0:1789672760.218599:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789672760.218612:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738353408:12345-0@lo:503: 00000100:00100000:0.0:1789672760.218927:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738353408:12345-0@lo:503: Request processed in 318us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672760.218935:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789672760.219051:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738353408:0@lo:503: 00000040:00080000:1.0:1789672760.219347:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789672760.219428:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738353536:0@lo:502: 00000100:00100000:1.0:1789672760.219475:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672760.220437:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d839900 going to sleep for 11 seconds 00000100:00100000:2.0:1789672760.220517:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738353536 00000100:00100000:2.0:1789672760.220526:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738353536 00000100:00100000:2.0:1789672760.220577:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789672760.220587:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738353536:12345-0@lo:502: 00000100:00100000:2.0:1789672760.222455:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738353536:12345-0@lo:502: Request processed in 1860us (2971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672760.222478:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789672760.222618:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738353536:0@lo:502: 00000040:00080000:1.0:1789672760.223321:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789672760.223361:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789672760.223397:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738353664:0@lo:502: 00000100:00100000:1.0:1789672760.223452:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672760.223491:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d839900 going to sleep for 11 seconds 00000100:00100000:2.0:1789672760.224004:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738353664 00000100:00100000:2.0:1789672760.224012:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738353664 00000100:00100000:2.0:1789672760.224047:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789672760.224056:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738353664:12345-0@lo:502: 00000100:00100000:2.0:1789672760.224167:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738353664:12345-0@lo:502: Request processed in 111us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672760.224174:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789672760.224361:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738353664:0@lo:502: 00000040:00080000:1.0:1789672760.224424:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789672760.224434:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789672760.226609:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672760.226622:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672760.226624:0:9521:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789672760.226631:0:9521:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfb4676b800 00000020:00000080:2.0:1789672760.226634:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789672760.226645:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672760.226647:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672760.226649:0:9521:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789672760.226679:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789672760.226983:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789672760.227043:0:9505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789672760.227072:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0a00/0x6c78c4f8c9964eea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964ef1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.227084:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0a00/0x6c78c4f8c9964eea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964ef1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672760.227146:0:9505:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789672760.227149:0:9505:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfb4676b800 10000000:01000000:1.0:1789672760.227152:0:9505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfb4676b800 10000000:01000000:1.0:1789672760.227156:0:9505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789672760.227162:0:9505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfb4676b800 from 1 10000000:01000000:1.0:1789672760.227165:0:9505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789672760.227316:0:9505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964ef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.227327:0:9505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964ef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.227339:0:9505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964ef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672760.227379:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738353792:0@lo:101: 00000100:00100000:1.0:1789672760.227451:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672760.227493:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d839c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672760.227516:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738353792 00000100:00100000:1.0:1789672760.227524:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738353792 00000100:00100000:1.0:1789672760.227579:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789672760.227589:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9505:x1876607738353792:12345-0@lo:101: 00010000:00010000:1.0:1789672760.227603:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672760.227616:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc61609e00/0x6c78c4f8c9964eff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964ef8 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.227641:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc61609e00/0x6c78c4f8c9964eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964ef8 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.227652:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc61609e00/0x6c78c4f8c9964eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964ef8 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.227880:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc61609e00, rc 0) 00000100:00100000:1.0:1789672760.227921:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:9505:x1876607738353792:12345-0@lo:101: Request processed in 332us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.227928:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789672760.227999:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738353792:0@lo:101: 00010000:00010000:1.0:1789672760.228012:0:9505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964ef8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964eff expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.228022:0:9505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964ef8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964eff expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672760.228131:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738353920:0@lo:501: 00000100:00100000:1.0:1789672760.228161:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672760.228182:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d839c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672760.228436:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738353920 00000100:00100000:1.0:1789672760.228442:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738353920 00000100:00100000:1.0:1789672760.228465:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789672760.228471:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:9505:x1876607738353920:12345-0@lo:501: 00000100:00100000:1.0:1789672760.228636:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:9505:x1876607738353920:12345-0@lo:501: Request processed in 164us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.228644:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789672760.230327:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738353920:0@lo:501: 00000100:00100000:2.0:1789672760.230429:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738354048:0@lo:503: 00000100:00100000:2.0:1789672760.230508:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.230595:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672760.230639:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738354048 00000100:00100000:1.0:1789672760.230647:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738354048 00000100:00100000:1.0:1789672760.231375:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789672760.231387:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:9505:x1876607738354048:12345-0@lo:503: 00000100:00100000:1.0:1789672760.231585:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:9505:x1876607738354048:12345-0@lo:503: Request processed in 200us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.231594:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789672760.231730:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738354048:0@lo:503: 00000040:00080000:2.0:1789672760.232046:0:9505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789672760.232131:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738354176:0@lo:502: 00000100:00100000:2.0:1789672760.232181:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.233021:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789672760.233114:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738354176 00000100:00100000:0.0:1789672760.233122:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738354176 00000100:00100000:0.0:1789672760.233161:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789672760.233170:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:9505:x1876607738354176:12345-0@lo:502: 00000100:00100000:0.0:1789672760.233487:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:9505:x1876607738354176:12345-0@lo:502: Request processed in 318us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672760.233495:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789672760.233619:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738354176:0@lo:502: 00000040:00080000:2.0:1789672760.234144:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789672760.234176:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789672760.234267:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789672760.234289:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789672760.234304:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789672760.234318:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789672760.234332:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789672760.234344:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789672760.234359:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789672760.234372:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789672760.234384:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789672760.234399:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789672760.234411:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789672760.234441:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789672760.234456:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789672760.234468:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789672760.234481:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789672760.234494:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789672760.234509:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789672760.234522:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789672760.234536:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789672760.234551:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789672760.235000:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789672760.235016:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789672760.235030:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789672760.235044:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789672760.235059:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789672760.235072:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1789672760.235085:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789672760.235115:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1789672760.235128:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1789672760.235138:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1789672760.235159:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1789672760.235170:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1789672760.235182:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1789672760.235405:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1789672760.235436:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1789672760.235451:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1789672760.235465:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1789672760.235477:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1789672760.235489:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1789672760.235503:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1789672760.235514:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1789672760.235525:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1789672760.235537:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1789672760.235573:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1789672760.235620:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738354304:0@lo:502: 00000100:00100000:2.0:1789672760.236183:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.236235:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672760.236399:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738354304 00000100:00100000:1.0:1789672760.236406:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738354304 00000100:00100000:1.0:1789672760.236464:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789672760.236474:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:9505:x1876607738354304:12345-0@lo:502: 00000100:00100000:1.0:1789672760.236639:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:9505:x1876607738354304:12345-0@lo:502: Request processed in 165us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.236647:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789672760.236907:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738354304:0@lo:502: 00000040:00080000:3.0:1789672760.236975:0:9505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1789672760.236986:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1789672760.238050:0:9522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789672760.238073:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cfb46773380) 00000020:00000080:3.0:1789672760.238102:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1789672760.238211:0:9522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfb4676b800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789672760.238215:0:9522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfb4676b800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789672760.238218:0:9522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfb4676b800 3 00010000:00080000:3.0:1789672760.238245:0:9522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfb4769a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789672760.242042:0:9522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1789672760.242347:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789672760.242398:0:9522:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789672760.242424:0:9522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6c78c4f8c9964f0d 00000100:00080000:3.0:1789672760.242436:0:9522:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789672760.242457:0:9522:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cfb4769a800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789672760.242500:0:9522:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfb4744dc00 x1876607738354432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789672760.242533:0:9522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789672760.243016:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876607738354432:0@lo:38: 00000100:00100000:2.0:1789672760.243096:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.243279:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738354688:0@lo:400: 00000100:00100000:2.0:1789672760.243324:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.243346:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738355200:0@lo:400: 00000100:00100000:2.0:1789672760.243368:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.243390:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789672760.243396:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738354560:0@lo:400: 00000100:00100000:2.0:1789672760.243415:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.243431:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876607738355072:0@lo:400: 00000100:00100000:2.0:1789672760.243450:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.243479:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738354944:0@lo:400: 00000100:00100000:2.0:1789672760.243502:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.243520:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738355456:0@lo:400: 00000100:00100000:2.0:1789672760.243543:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.243579:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789672760.243585:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738354816:0@lo:400: 00000100:00100000:2.0:1789672760.243605:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.243615:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738355328:0@lo:400: 00000100:00100000:2.0:1789672760.243632:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.243709:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738354688 00000100:00100000:2.0:1789672760.243718:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738354688 00000100:00100000:2.0:1789672760.243760:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738354944 00000100:00100000:2.0:1789672760.243763:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738354944 00000100:00100000:3.0:1789672760.244253:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738354432 00000100:00100000:3.0:1789672760.244258:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738354432 00000100:00100000:3.0:1789672760.244277:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738355200 00000100:00100000:3.0:1789672760.244279:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738355200 00000100:00100000:2.0:1789672760.244321:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789672760.244332:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738354688:12345-0@lo:400: 00000100:00100000:2.0:1789672760.244404:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738354688:12345-0@lo:400: Request processed in 73us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672760.244412:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789672760.244594:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789672760.245254:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738354560 00000100:00100000:3.0:1789672760.245263:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738354560 00000100:00100000:3.0:1789672760.245277:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738355072 00000100:00100000:3.0:1789672760.245279:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738355072 00000100:00100000:3.0:1789672760.245334:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738354816 00000100:00100000:3.0:1789672760.245338:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738354816 00000100:00100000:3.0:1789672760.245351:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789672760.245877:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672760.245883:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789672760.246038:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738355456 00000100:00100000:1.0:1789672760.246053:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738355456 00000100:00100000:1.0:1789672760.246085:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738355328 00000100:00100000:1.0:1789672760.246088:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738355328 00000100:00100000:1.0:1789672760.246108:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789672760.246115:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738355456:12345-0@lo:400: 00000100:00100000:1.0:1789672760.246200:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738355456:12345-0@lo:400: Request processed in 75us (2645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.246208:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789672760.246230:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789672760.246236:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738355328:12345-0@lo:400: 00000100:00100000:1.0:1789672760.246261:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738355328:12345-0@lo:400: Request processed in 26us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.246267:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789672760.246528:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738354944:12345-0@lo:400: 00000100:00100000:2.0:1789672760.246578:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738354944:12345-0@lo:400: Request processed in 1977us (3075us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672760.246587:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789672760.246615:0:6512:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789672760.246623:0:6512:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789672760.246636:0:6514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789672760.246643:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789672760.246679:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1876607738354432:12345-0@lo:38: 00010000:00080000:2.0:1789672760.246722:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:2.0:1789672760.246770:0:6514:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6c78c4f8c9964f14 00000004:00100000:2.0:1789672760.247001:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789672760.247052:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8cfb46bf7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789672760.247104:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1876607738354432:12345-0@lo:38: Request processed in 454us (4008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672760.247111:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789672760.247126:0:6514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789672760.247134:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789672760.247141:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738354560:12345-0@lo:400: 00000100:00100000:2.0:1789672760.247170:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738354560:12345-0@lo:400: Request processed in 30us (3754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672760.247176:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789672760.247186:0:6514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789672760.247205:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789672760.247212:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876607738355072:12345-0@lo:400: 00000100:00100000:2.0:1789672760.247250:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876607738355072:12345-0@lo:400: Request processed in 39us (3799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672760.247255:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789672760.247266:0:6514:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789672760.247272:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789672760.247278:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738354816:12345-0@lo:400: 00000100:00100000:2.0:1789672760.247496:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738354816:12345-0@lo:400: Request processed in 217us (3889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672760.247503:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789672760.247572:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfb4744dc00 x1876607738354432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789672770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672760.247590:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789672760.247599:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789672760.247607:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789672760.247611:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789672760.247613:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb4769a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789672760.247620:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876607738354432:0@lo:38: 00010000:00080000:2.0:1789672760.247911:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7dac2d80 x1876607738354560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672760.247921:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738354560:0@lo:400: 00010000:00080000:2.0:1789672760.247934:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfb477a1c00 x1876607738355072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672760.247944:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876607738355072:0@lo:400: 00000100:00100000:2.0:1789672760.247955:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738354688:0@lo:400: 00010000:00080000:1.0:1789672760.248584:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7dac1180 x1876607738354816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672760.248597:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738354816:0@lo:400: 00010000:00080000:1.0:1789672760.248609:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfb477a2a00 x1876607738355328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672760.248617:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738355328:0@lo:400: 00000100:00100000:1.0:1789672760.248629:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738354944:0@lo:400: 00010000:00080000:1.0:1789672760.248641:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfb477a3b80 x1876607738355456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672760.248648:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738355456:0@lo:400: 00000020:01000004:2.0:1789672760.250113:0:9522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789672760.250152:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8cfb477b0000) 00000020:00000080:2.0:1789672760.250180:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1789672760.250987:0:9522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfb4676b800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789672760.250993:0:9522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfb4676b800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789672760.250996:0:9522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfb4676b800 3 00010000:00080000:2.0:1789672760.251030:0:9522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfb46bf0800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.150@tcp at head 00000100:00100000:3.0:1789672760.251516:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738355200:12345-0@lo:400: 00000100:00100000:3.0:1789672760.251648:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738355200:12345-0@lo:400: Request processed in 6290us (8277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672760.251686:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789672760.252590:0:9523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744ce00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9523:1876607738355584:0@lo:901: 00000100:00100000:3.0:1789672760.252692:0:9523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789672760.252905:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfb477a0e00 x1876607738355200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672760.252921:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738355200:0@lo:400: 00000100:00100000:3.0:1789672760.253518:0:9523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467e8000 going to sleep for 11 seconds 00000100:00100000:1.0:1789672760.254876:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738355584 00000100:00100000:1.0:1789672760.254889:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738355584 00000100:00100000:1.0:1789672760.254977:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789672760.254988:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9523:x1876607738355584:12345-0@lo:901: 00000100:00100000:1.0:1789672760.255129:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9523:x1876607738355584:12345-0@lo:901: Request processed in 143us (2436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.255135:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789672760.255505:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672760.255509:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789672760.263418:0:9522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00010000:00080000:0.0:1789672760.265021:0:9523:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfb4744ce00 x1876607738355584/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789672776 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672760.265042:0:9523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744ce00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9523:1876607738355584:0@lo:901: 00000020:00000080:2.0:1789672760.265678:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789672760.265744:0:9522:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789672760.265759:0:9522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x6c78c4f8c9964f22 00000100:00080000:2.0:1789672760.265769:0:9522:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789672760.266488:0:9522:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8cfb46bf0800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789672760.266529:0:9522:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfb477a0e00 x1876607738355712/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789672760.266583:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1876607738355712:0@lo:38: 00000100:00100000:2.0:1789672760.266697:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672760.266759:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738355712 00000100:00100000:2.0:1789672760.266765:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738355712 00000100:00100000:2.0:1789672760.267971:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789672760.267979:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1876607738355712:12345-0@lo:38: 00010000:00080000:2.0:1789672760.268012:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:2.0:1789672760.268050:0:6514:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x6c78c4f8c9964f29 00000004:00100000:2.0:1789672760.268067:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789672760.268102:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8cfb419e7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789672760.268171:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1876607738355712:12345-0@lo:38: Request processed in 191us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672760.268179:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789672760.269868:0:9522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00010000:00080000:2.0:1789672760.270909:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfb477a0e00 x1876607738355712/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789672770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672760.270924:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789672760.270936:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789672760.270947:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789672760.270953:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789672760.270958:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb46bf0800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789672760.270973:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1876607738355712:0@lo:38: 00000040:00080000:0.0:1789672760.271527:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1789672760.272899:0:9505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1789672760.272986:0:9505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789672760.273011:0:9505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964ef8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964eff expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.273025:0:9505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964ef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964eff expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789672760.273096:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789672760.273098:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789672760.273100:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789672760.273101:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789672760.273103:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789672760.273105:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789672760.273106:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789672760.273108:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789672760.273109:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789672760.273111:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789672760.273113:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789672760.273117:0:9505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789672760.273120:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789672760.273121:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789672760.273122:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789672760.273124:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789672760.273125:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789672760.273126:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789672760.273127:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789672760.273128:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789672760.273129:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789672760.273130:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789672760.273131:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789672760.273156:0:9505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789672760.273176:0:9505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738355840:0@lo:253: 00000100:00100000:0.0:1789672760.275056:0:9505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672760.275112:0:9505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc499183c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672760.275337:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738355840 00000100:00100000:2.0:1789672760.275349:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738355840 00000100:00100000:2.0:1789672760.275422:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789672760.275433:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:9505:x1876607738355840:12345-0@lo:253: 20000000:01000000:2.0:1789672760.275464:0:6507:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789672760.275479:0:6507:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789672760.286540:0:6507:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789672760.286569:0:6507:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789672760.286983:0:6528:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789672760.286990:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789672760.287014:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfc52434e00/0x6c78c4f8c9964f30 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.287035:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc427c3c00/0x6c78c4f8c9964e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e1f expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.287060:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc427c2200/0x6c78c4f8c9964e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964e65 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.287068:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfc52434e00/0x6c78c4f8c9964f30 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.287109:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc427c2200/0x6c78c4f8c9964e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964e65 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.287124:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc427c2200/0x6c78c4f8c9964e6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e65 expref: 17 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672760.287142:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876607738355968:0@lo:104: 00000100:00100000:0.0:1789672760.287284:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789672760.287930:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc427c3c00/0x6c78c4f8c9964e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964e1f expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.287942:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc427c3c00/0x6c78c4f8c9964e26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e1f expref: 17 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672760.287953:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876607738356096:0@lo:104: 00000100:00100000:0.0:1789672760.287981:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672760.288000:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc49918540 going to sleep for 11 seconds 00000100:00100000:0.0:1789672760.288023:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738355968 00000100:00100000:0.0:1789672760.288030:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738355968 00000100:00100000:0.0:1789672760.288070:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738356096 00000100:00100000:0.0:1789672760.288074:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738356096 00000100:00100000:0.0:1789672760.288088:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789672760.288096:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:6528:x1876607738355968:12345-0@lo:104: 00010000:00010000:0.0:1789672760.288120:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2000/0x6c78c4f8c9964e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.288185:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789672760.288919:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672760.288928:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2000/0x6c78c4f8c9964e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.288938:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc427c2000 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:1.0:1789672760.288943:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2000/0x6c78c4f8c9964e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.288953:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2000/0x6c78c4f8c9964e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672760.288961:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2000/0x6c78c4f8c9964e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672760.288968:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789672760.289010:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2000/0x6c78c4f8c9964e65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.289018:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672760.289046:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2000/0x6c78c4f8c9964e65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.289054:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2000/0x6c78c4f8c9964e65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e6c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.289083:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672760.289084:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672760.289086:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672760.289102:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738356224:0@lo:103: 00000100:00100000:1.0:1789672760.289144:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672760.289209:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738356224 00000100:00100000:1.0:1789672760.289216:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738356224 00010000:00010000:1.0:1789672760.289243:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc427c2200/0x6c78c4f8c9964e6c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e65 expref: 18 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672760.289269:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789672760.289275:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:3635:x1876607738356224:12345-0@lo:103: 00010000:00010000:1.0:1789672760.289287:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672760.289300:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc427c2200/0x6c78c4f8c9964e6c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e65 expref: 18 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.289310:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc427c2200/0x6c78c4f8c9964e6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e65 expref: 18 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672760.289328:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672760.289352:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:3635:x1876607738356224:12345-0@lo:103: Request processed in 77us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672760.289356:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789672760.289400:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738356224:0@lo:103: 00000100:00100000:2.0:1789672760.291158:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:9505:x1876607738355840:12345-0@lo:253: Request processed in 15719us (16101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672760.291172:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789672760.291353:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:6528:x1876607738355968:12345-0@lo:104: Request processed in 3255us (4067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672760.291363:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789672760.291387:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789672760.291400:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6528:x1876607738356096:12345-0@lo:104: 00010000:00010000:0.0:1789672760.291421:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887000/0x6c78c4f8c9964e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964e26 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672760.292624:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789672760.292641:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:6528:x1876607738356096:12345-0@lo:104: Request processed in 1242us (4654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672760.292651:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789672760.293049:0:9505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9505:1876607738355840:0@lo:253: 10000000:01000000:1.0:1789672760.293065:0:9505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789672760.293083:0:9505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789672760.293084:0:9505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789672760.293086:0:9505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789672760.293088:0:9505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789672760.293089:0:9505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789672760.293090:0:9505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789672760.293092:0:9505:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789672760.293093:0:9505:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789672760.293095:0:9505:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789672760.293097:0:9505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789672760.293098:0:9505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789672760.293115:0:9505:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789672760.299057:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672760.299075:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887000/0x6c78c4f8c9964e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964e26 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.299089:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887000 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:2.0:1789672760.299094:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887000/0x6c78c4f8c9964e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964e26 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.299105:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887000/0x6c78c4f8c9964e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964e26 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672760.299125:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887000/0x6c78c4f8c9964e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964e26 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672760.299133:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789672760.299200:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887000/0x6c78c4f8c9964e1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e26 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.299223:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672760.299254:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887000/0x6c78c4f8c9964e1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e26 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.299261:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887000/0x6c78c4f8c9964e1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964e26 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.299278:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672760.299280:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672760.299281:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672760.303307:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672760.303338:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738356352:0@lo:103: 00000100:00100000:2.0:1789672760.303421:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672760.304829:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738356352 00000100:00100000:3.0:1789672760.304843:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738356352 00010000:00010000:3.0:1789672760.304892:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc427c3c00/0x6c78c4f8c9964e26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e1f expref: 17 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672760.304931:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789672760.304940:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:3635:x1876607738356352:12345-0@lo:103: 00010000:00010000:3.0:1789672760.304967:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672760.304974:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc427c3c00/0x6c78c4f8c9964e26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e1f expref: 17 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.304989:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc427c3c00/0x6c78c4f8c9964e26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964e1f expref: 17 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.305013:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfc52434e00/0x6c78c4f8c9964f30 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.305022:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52434e00/0x6c78c4f8c9964f30 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789672760.305042:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018052821s 00010000:00010000:3.0:1789672760.305048:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc52434e00/0x6c78c4f8c9964f30 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.305055:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc52434e00/0x6c78c4f8c9964f30 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.305061:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfc52434e00/0x6c78c4f8c9964f30 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.305068:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfc52434e00/0x6c78c4f8c9964f30 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.305075:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434e00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789672760.305081:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfc52434e00/0x6c78c4f8c9964f30 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.305090:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfc52434e00/0x6c78c4f8c9964f30 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.305105:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfc52434e00/0x6c78c4f8c9964f30 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672760.305117:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672760.305185:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:3635:x1876607738356352:12345-0@lo:103: Request processed in 247us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672760.305206:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789672760.309649:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738356352:0@lo:103: 00080000:10000000:1.0:1789672760.310351:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789672760.310986:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789672760.311217:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789672760.311539:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789672760.311918:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789672760.312145:0:9505:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:2.0:1789672760.315448:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc427c2200/0x6c78c4f8c9964e6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964e65 expref: 16 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672760.315470:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876607738355968:0@lo:104: 00010000:00010000:2.0:1789672760.315485:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc427c3c00/0x6c78c4f8c9964e26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964e1f expref: 15 pid: 6507 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672760.315495:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6528:1876607738356096:0@lo:104: 00010000:00010000:2.0:1789672760.315521:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfc52434e00/0x6c78c4f8c9964f30 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.315532:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfc52434e00/0x6c78c4f8c9964f30 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.315552:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfc52434e00/0x6c78c4f8c9964f30 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672760.315569:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc52434e00/0x6c78c4f8c9964f30 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1789672760.319030:0:9505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789672760.330876:0:9505:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789672760.330890:0:9505:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789672760.330946:0:9505:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789672760.331013:0:9505:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789672760.331054:0:9505:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789672760.331088:0:9505:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789672760.335156:0:9505:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789672760.336425:0:9505:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789672760.517710:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672761.156202:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672761.156232:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738356480:0@lo:13: 00000100:00100000:2.0:1789672761.156304:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672761.156371:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738356480 00000100:00100000:2.0:1789672761.156379:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738356480 00000100:00100000:2.0:1789672761.156434:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789672761.156444:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738356480:12345-0@lo:13: 00002000:00000024:2.0:1789672761.156474:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672761.156520:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738356480:12345-0@lo:13: Request processed in 77us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672761.156527:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789672761.156578:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb477a0e00 x1876607738356480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672761.156595:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738356480:0@lo:13: 00000100:00100000:3.0:1789672761.158871:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789672761.158900:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738356608:0@lo:13: 00000100:00100000:3.0:1789672761.158971:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672761.159246:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738356608 00000100:00100000:0.0:1789672761.159256:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738356608 00000100:00100000:0.0:1789672761.159355:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789672761.159365:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738356608:12345-0@lo:13: 00002000:00000024:0.0:1789672761.159389:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672761.159448:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738356608:12345-0@lo:13: Request processed in 85us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672761.159454:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789672761.159525:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb46802a00 x1876607738356608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672761.159553:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46802a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738356608:0@lo:13: 00000020:00000004:1.0:1789672761.299440:0:9579:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789672761.299835:0:9579:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789672761.548648:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672762.182010:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672762.182037:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738356736:0@lo:41: 00000100:00100000:0.0:1789672762.182113:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672762.182199:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738356736 00000100:00100000:0.0:1789672762.182208:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738356736 00000100:00100000:0.0:1789672762.182258:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789672762.182267:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738356736:12345-0@lo:41: 00000004:00000024:0.0:1789672762.182303:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789672762.182348:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738356736:12345-0@lo:41: Request processed in 83us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672762.182355:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789672762.182401:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738356736:0@lo:41: 00010000:00010000:1.0:1789672762.564674:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672763.205161:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672763.205194:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738356864:0@lo:41: 00000100:00100000:1.0:1789672763.205290:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672763.205396:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738356864 00000100:00100000:3.0:1789672763.205405:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738356864 00000100:00100000:3.0:1789672763.205479:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789672763.205489:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738356864:12345-0@lo:41: 00000004:00000024:3.0:1789672763.205535:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1789672763.205585:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738356864:12345-0@lo:41: Request processed in 97us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672763.205591:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789672763.205769:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738356864:0@lo:41: 00010000:00010000:2.0:1789672763.588077:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672764.613111:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672765.635871:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672765.770405:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738356992:0@lo:400: 00000100:00100000:0.0:1789672765.770493:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672765.770559:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738357504:0@lo:400: 00000100:00100000:0.0:1789672765.770588:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672765.770609:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738358016:0@lo:400: 00000100:00100000:0.0:1789672765.770631:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672765.770655:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789672765.770678:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738357120:0@lo:400: 00000100:00100000:0.0:1789672765.770702:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672765.770731:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738357632:0@lo:400: 00000100:00100000:0.0:1789672765.770753:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672765.770774:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738358144:0@lo:400: 00000100:00100000:0.0:1789672765.770804:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672765.770839:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738357248:0@lo:400: 00000100:00100000:0.0:1789672765.770865:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672765.771632:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738357760:0@lo:400: 00000100:00100000:0.0:1789672765.771714:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672765.771748:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738358272:0@lo:400: 00000100:00100000:0.0:1789672765.771773:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672765.771961:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789672765.771969:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738357376:0@lo:400: 00000100:00100000:0.0:1789672765.772011:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672765.772028:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738357888:0@lo:400: 00000100:00100000:0.0:1789672765.772128:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672765.772174:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738356992 00000100:00100000:0.0:1789672765.772183:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738356992 00000100:00100000:0.0:1789672765.772232:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789672765.772241:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:3637:x1876607738356992:12345-0@lo:400: 00000100:00100000:0.0:1789672765.772296:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:3637:x1876607738356992:12345-0@lo:400: Request processed in 56us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672765.772304:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789672765.772338:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738357504 00000100:00100000:0.0:1789672765.772343:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738357504 00000100:00100000:0.0:1789672765.772446:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738357248 00000100:00100000:0.0:1789672765.772451:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738357248 00000100:00100000:0.0:1789672765.772482:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789672765.772489:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738357504:12345-0@lo:400: 00000100:00100000:0.0:1789672765.772524:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738357504:12345-0@lo:400: Request processed in 36us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672765.772532:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789672765.772544:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789672765.772550:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738357248:12345-0@lo:400: 00000100:00100000:0.0:1789672765.772579:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738357248:12345-0@lo:400: Request processed in 30us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672765.772594:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789672765.772612:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738358016 00000100:00100000:0.0:1789672765.772616:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738358016 00000100:00100000:0.0:1789672765.772649:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738357888 00000100:00100000:0.0:1789672765.772651:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738357888 00000100:00100000:0.0:1789672765.772695:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789672765.772702:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738358016:12345-0@lo:400: 00000100:00100000:0.0:1789672765.772867:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738358016:12345-0@lo:400: Request processed in 164us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672765.772946:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789672765.772962:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789672765.772969:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738357888:12345-0@lo:400: 00000100:00100000:0.0:1789672765.772998:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738357888:12345-0@lo:400: Request processed in 31us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672765.773004:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789672765.773026:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738357120 00000100:00100000:0.0:1789672765.773029:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738357120 00000100:00100000:0.0:1789672765.773126:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738357632 00000100:00100000:0.0:1789672765.773131:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738357632 00000100:00100000:0.0:1789672765.773144:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738358144 00000100:00100000:0.0:1789672765.773147:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738358144 00000100:00100000:0.0:1789672765.773163:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738357760 00000100:00100000:0.0:1789672765.773166:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738357760 00000100:00100000:0.0:1789672765.773178:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738358272 00000100:00100000:0.0:1789672765.773181:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738358272 00000100:00100000:0.0:1789672765.773192:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738357376 00000100:00100000:0.0:1789672765.773195:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738357376 00000100:00100000:0.0:1789672765.773207:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789672765.773213:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738357120:12345-0@lo:400: 00000100:00100000:0.0:1789672765.773257:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738357120:12345-0@lo:400: Request processed in 44us (2554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672765.773631:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789672765.773647:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789672765.773654:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738357632:12345-0@lo:400: 00000100:00100000:1.0:1789672765.773753:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789672765.773762:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738358144:12345-0@lo:400: 00000100:00100000:1.0:1789672765.773814:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738358144:12345-0@lo:400: Request processed in 54us (3009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672765.773820:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789672765.773841:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789672765.773847:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738357760:12345-0@lo:400: 00000100:00100000:0.0:1789672765.774149:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738357632:12345-0@lo:400: Request processed in 496us (3394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672765.774156:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789672765.774169:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789672765.774176:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738358272:12345-0@lo:400: 00000100:00100000:0.0:1789672765.774204:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738358272:12345-0@lo:400: Request processed in 29us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672765.774209:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789672765.774221:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789672765.774228:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738357376:12345-0@lo:400: 00000100:00100000:0.0:1789672765.774254:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738357376:12345-0@lo:400: Request processed in 27us (2242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672765.774260:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1789672765.774287:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789672765.774292:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672765.774295:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789672765.774338:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8c9500 x1876607738357376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672765.774354:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738357376:0@lo:400: 00000100:00100000:1.0:1789672765.774455:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738357760:12345-0@lo:400: Request processed in 607us (2740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672765.774472:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789672765.774513:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8c8000 x1876607738357120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672765.774524:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738357120:0@lo:400: 00010000:00080000:1.0:1789672765.774535:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8c9180 x1876607738357632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672765.774544:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738357632:0@lo:400: 00010000:00080000:1.0:1789672765.774561:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8c9880 x1876607738358144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672765.774570:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738358144:0@lo:400: 00000100:00100000:1.0:1789672765.774580:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738356992:0@lo:400: 00000100:00100000:1.0:1789672765.774590:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738357504:0@lo:400: 00010000:00080000:1.0:1789672765.774601:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8ca300 x1876607738358016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672765.774610:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738358016:0@lo:400: 00010000:00080000:0.0:1789672765.775137:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8ca680 x1876607738357888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672765.775171:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738357888:0@lo:400: 00000100:00100000:0.0:1789672765.775192:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738357248:0@lo:400: 00010000:00080000:0.0:1789672765.775204:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8c8380 x1876607738357760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672765.775211:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738357760:0@lo:400: 00010000:00080000:0.0:1789672765.775222:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8cbb80 x1876607738358272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672765.775230:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738358272:0@lo:400: 00000100:00100000:1.0:1789672766.277993:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672766.278021:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738358400:0@lo:13: 00000100:00100000:1.0:1789672766.278087:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672766.278484:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738358400 00000100:00100000:2.0:1789672766.278495:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738358400 00000100:00100000:2.0:1789672766.278554:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789672766.278564:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738358400:12345-0@lo:13: 00002000:00000024:2.0:1789672766.278591:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672766.278638:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738358400:12345-0@lo:13: Request processed in 76us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672766.278645:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789672766.278706:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb46800000 x1876607738358400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672766.278797:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738358400:0@lo:13: 00000100:00100000:3.0:1789672766.278918:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672766.278929:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738358528:0@lo:13: 00000100:00100000:3.0:1789672766.278958:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672766.279122:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738358528 00000100:00100000:1.0:1789672766.279139:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738358528 00000100:00100000:1.0:1789672766.279160:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789672766.279166:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738358528:12345-0@lo:13: 00002000:00000024:1.0:1789672766.279176:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672766.279215:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738358528:12345-0@lo:13: Request processed in 49us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672766.279221:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789672766.279620:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb4744f800 x1876607738358528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672766.279646:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738358528:0@lo:13: 00010000:00010000:1.0:1789672766.660543:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789672767.270794:0:9868:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789672767.302134:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738358656:0@lo:41: 00000100:00100000:0.0:1789672767.302222:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672767.302362:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738358656 00000100:00100000:2.0:1789672767.302372:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738358656 00000100:00100000:2.0:1789672767.302428:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789672767.302449:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738358656:12345-0@lo:41: 00000004:00000024:2.0:1789672767.302488:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789672767.302545:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738358656:12345-0@lo:41: Request processed in 98us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672767.302551:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789672767.302615:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738358656:0@lo:41: 00010000:00010000:3.0:1789672767.683971:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789672768.214576:0:9921:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789672768.216842:0:9921:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789672768.328213:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672768.328241:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738358784:0@lo:41: 00000100:00100000:0.0:1789672768.328322:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672768.328507:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738358784 00000100:00100000:3.0:1789672768.328517:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738358784 00000100:00100000:3.0:1789672768.328570:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789672768.328579:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738358784:12345-0@lo:41: 00000004:00000024:3.0:1789672768.328612:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1789672768.328700:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738358784:12345-0@lo:41: Request processed in 121us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672768.328707:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789672768.328794:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738358784:0@lo:41: 00010000:00010000:3.0:1789672768.709035:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789672769.348003:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789672769.348012:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfc816a3000 from 39 10000000:01000000:2.0:1789672769.348018:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789672769.348070:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9964f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672769.348103:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9964f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672769.348115:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9964f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672769.348141:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738358912:0@lo:101: 00000100:00100000:2.0:1789672769.348222:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.348302:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb46884b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672769.352879:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738358912 00000100:00100000:0.0:1789672769.352897:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738358912 00000100:00100000:0.0:1789672769.352977:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789672769.352989:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:6509:x1876607738358912:12345-0@lo:101: 00010000:00010000:0.0:1789672769.353007:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672769.353028:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964f3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964f37 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.353057:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f37 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.353069:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f37 expref: 16 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.353094:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435600, rc 0) 00000100:00100000:0.0:1789672769.353182:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738358912:12345-0@lo:101: Request processed in 195us (4960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.353189:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789672769.353252:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738358912:0@lo:101: 00010000:00010000:0.0:1789672769.353272:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9964f37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964f3e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.353282:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9964f37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964f3e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672769.353361:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738359040:0@lo:501: 00000100:00100000:0.0:1789672769.353408:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672769.353447:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4a763780 going to sleep for 11 seconds 00000100:00100000:3.0:1789672769.353530:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738359040 00000100:00100000:3.0:1789672769.353536:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738359040 00000100:00100000:3.0:1789672769.353570:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789672769.353577:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738359040:12345-0@lo:501: 00000100:00100000:3.0:1789672769.353729:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738359040:12345-0@lo:501: Request processed in 153us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672769.353737:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789672769.354105:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738359040:0@lo:501: 00000100:00100000:0.0:1789672769.354141:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738359168:0@lo:503: 00000100:00100000:0.0:1789672769.354191:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672769.354419:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4a763780 going to sleep for 11 seconds 00000100:00100000:3.0:1789672769.361514:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738359168 00000100:00100000:3.0:1789672769.361534:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738359168 00000100:00100000:3.0:1789672769.361604:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789672769.361616:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738359168:12345-0@lo:503: 00000100:00100000:3.0:1789672769.361847:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738359168:12345-0@lo:503: Request processed in 233us (7655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672769.361863:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789672769.362980:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738359168:0@lo:503: 00000100:00100000:1.0:1789672769.368204:0:9973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46802300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9973:1876607738359296:0@lo:502: 00000100:00100000:1.0:1789672769.368302:0:9973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672769.368420:0:9973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467e8000 going to sleep for 11 seconds 00000100:00100000:3.0:1789672769.368470:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738359296 00000100:00100000:3.0:1789672769.368479:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738359296 00000100:00100000:3.0:1789672769.368580:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789672769.368592:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9973:x1876607738359296:12345-0@lo:502: 00000100:00100000:3.0:1789672769.368772:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9973:x1876607738359296:12345-0@lo:502: Request processed in 182us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672769.368780:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789672769.368877:0:9973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46802300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9973:1876607738359296:0@lo:502: 00000100:00100000:1.0:1789672769.368927:0:9973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46802300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9973:1876607738359424:0@lo:502: 00000100:00100000:1.0:1789672769.368961:0:9973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672769.369207:0:9973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467e8000 going to sleep for 11 seconds 00000100:00100000:0.0:1789672769.369295:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738359424 00000100:00100000:0.0:1789672769.369301:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738359424 00000100:00100000:0.0:1789672769.369325:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789672769.369332:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9973:x1876607738359424:12345-0@lo:502: 00000100:00100000:0.0:1789672769.369436:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:9973:x1876607738359424:12345-0@lo:502: Request processed in 103us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.369444:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789672769.369535:0:9973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46802300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9973:1876607738359424:0@lo:502: 00000040:00080000:1.0:1789672769.369554:0:9973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789672769.370285:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789672769.370314:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789672769.370329:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9964f37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964f3e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.370341:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9964f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964f3e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672769.370352:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789672769.370355:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789672769.370359:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789672769.370402:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c9964f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.370412:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c9964f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.370422:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c9964f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672769.370442:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738359552:0@lo:101: 00000100:00100000:0.0:1789672769.370493:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672769.370536:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4a763240 going to sleep for 11 seconds 00000100:00100000:1.0:1789672769.371292:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738359552 00000100:00100000:1.0:1789672769.371301:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738359552 00000100:00100000:1.0:1789672769.371344:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789672769.371354:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738359552:12345-0@lo:101: 00010000:00010000:1.0:1789672769.371368:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672769.371385:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc61609800/0x6c78c4f8c9964f4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964f45 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672769.371439:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc61609800/0x6c78c4f8c9964f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f45 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672769.371450:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc61609800/0x6c78c4f8c9964f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f45 expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672769.371460:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc61609800, rc 0) 00000100:00100000:1.0:1789672769.371512:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738359552:12345-0@lo:101: Request processed in 160us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.371519:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789672769.371695:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738359552:0@lo:101: 00010000:00010000:0.0:1789672769.371712:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c9964f45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964f4c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.371721:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c9964f45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964f4c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672769.371801:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738359680:0@lo:501: 00000100:00100000:0.0:1789672769.371967:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672769.371996:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4a763240 going to sleep for 11 seconds 00000100:00100000:0.0:1789672769.372012:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738359680 00000100:00100000:0.0:1789672769.372016:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738359680 00000100:00100000:0.0:1789672769.372039:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789672769.372046:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738359680:12345-0@lo:501: 00000100:00100000:0.0:1789672769.372242:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738359680:12345-0@lo:501: Request processed in 196us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.372250:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789672769.374439:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738359680:0@lo:501: 00000100:00100000:3.0:1789672769.374515:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738359808:0@lo:503: 00000100:00100000:3.0:1789672769.374589:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672769.374701:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467bc540 going to sleep for 11 seconds 00000100:00100000:0.0:1789672769.378993:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738359808 00000100:00100000:0.0:1789672769.379008:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738359808 00000100:00100000:0.0:1789672769.380494:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789672769.380516:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738359808:12345-0@lo:503: 00000100:00100000:0.0:1789672769.380742:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738359808:12345-0@lo:503: Request processed in 235us (6153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.380752:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789672769.380877:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738359808:0@lo:503: 00000100:00100000:3.0:1789672769.381419:0:9974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9974:1876607738359936:0@lo:502: 00000100:00100000:3.0:1789672769.381470:0:9974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672769.383778:0:9974:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467bc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672769.384412:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738359936 00000100:00100000:1.0:1789672769.384424:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738359936 00000100:00100000:1.0:1789672769.384478:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789672769.384489:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:9974:x1876607738359936:12345-0@lo:502: 00000100:00100000:1.0:1789672769.384681:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:9974:x1876607738359936:12345-0@lo:502: Request processed in 194us (3210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.384690:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789672769.385162:0:9974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9974:1876607738359936:0@lo:502: 00000020:01000000:3.0:1789672769.385200:0:9974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789672769.385211:0:9974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672769.385213:0:9974:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789672769.385219:0:9974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789672769.385222:0:9974:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789672769.385256:0:9974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9974:1876607738360064:0@lo:502: 00000100:00100000:3.0:1789672769.385301:0:9974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672769.385334:0:9974:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc47f1ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789672769.385406:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738360064 00000100:00100000:1.0:1789672769.385412:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738360064 00000100:00100000:1.0:1789672769.385435:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789672769.385443:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:9974:x1876607738360064:12345-0@lo:502: 00000100:00100000:1.0:1789672769.385621:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:9974:x1876607738360064:12345-0@lo:502: Request processed in 178us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.385628:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789672769.385820:0:9974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9974:1876607738360064:0@lo:502: 00000020:01000000:3.0:1789672769.386009:0:9974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789672769.386014:0:9974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672769.386015:0:9974:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789672769.386019:0:9974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789672769.386212:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1789672769.386248:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789672769.386260:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c9964f45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964f4c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672769.386271:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c9964f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964f4c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672769.386282:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789672769.386285:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfc7c498000 from 39 10000000:01000000:2.0:1789672769.386287:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789672769.386314:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9964f53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672769.386322:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9964f53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672769.386331:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9964f53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672769.386358:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738360192:0@lo:101: 00000100:00100000:2.0:1789672769.392147:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.392218:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb46884840 going to sleep for 11 seconds 00000100:00100000:0.0:1789672769.392300:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738360192 00000100:00100000:0.0:1789672769.392310:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738360192 00000100:00100000:0.0:1789672769.392385:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789672769.392406:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738360192:12345-0@lo:101: 00010000:00010000:0.0:1789672769.392425:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672769.392445:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52434a00/0x6c78c4f8c9964f5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964f53 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.392475:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52434a00/0x6c78c4f8c9964f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f53 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.392502:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52434a00/0x6c78c4f8c9964f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f53 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.392510:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434a00, rc 0) 00000100:00100000:0.0:1789672769.392576:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738360192:12345-0@lo:101: Request processed in 182us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.392583:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789672769.392758:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738360192:0@lo:101: 00010000:00010000:2.0:1789672769.392776:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9964f53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964f5a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672769.392786:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9964f53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964f5a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672769.392880:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738360320:0@lo:501: 00000100:00100000:2.0:1789672769.392930:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.392952:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb46884840 going to sleep for 11 seconds 00000100:00100000:0.0:1789672769.393169:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738360320 00000100:00100000:0.0:1789672769.393175:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738360320 00000100:00100000:0.0:1789672769.393206:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789672769.393212:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738360320:12345-0@lo:501: 00000100:00100000:0.0:1789672769.393346:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738360320:12345-0@lo:501: Request processed in 133us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.393353:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789672769.393556:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738360320:0@lo:501: 00000100:00100000:2.0:1789672769.393585:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738360448:0@lo:503: 00000100:00100000:2.0:1789672769.393625:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.393646:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb46884840 going to sleep for 11 seconds 00000100:00100000:1.0:1789672769.393737:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738360448 00000100:00100000:1.0:1789672769.393743:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738360448 00000100:00100000:1.0:1789672769.393766:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789672769.393781:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738360448:12345-0@lo:503: 00000100:00100000:1.0:1789672769.393889:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738360448:12345-0@lo:503: Request processed in 109us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.393896:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789672769.394062:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738360448:0@lo:503: 00000100:00100000:2.0:1789672769.394411:0:9975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9975:1876607738360576:0@lo:502: 00000100:00100000:2.0:1789672769.394451:0:9975:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.394481:0:9975:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb468849c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672769.394528:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738360576 00000100:00100000:1.0:1789672769.394533:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738360576 00000100:00100000:1.0:1789672769.394564:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789672769.394572:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:9975:x1876607738360576:12345-0@lo:502: 00000100:00100000:1.0:1789672769.394654:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:9975:x1876607738360576:12345-0@lo:502: Request processed in 82us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.394686:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789672769.394804:0:9975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9975:1876607738360576:0@lo:502: 00000100:00100000:2.0:1789672769.394872:0:9975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9975:1876607738360704:0@lo:502: 00000100:00100000:2.0:1789672769.395162:0:9975:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.395189:0:9975:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb468849c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672769.395240:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738360704 00000100:00100000:1.0:1789672769.395245:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738360704 00000100:00100000:1.0:1789672769.395277:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789672769.395284:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:9975:x1876607738360704:12345-0@lo:502: 00000100:00100000:1.0:1789672769.395365:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:9975:x1876607738360704:12345-0@lo:502: Request processed in 81us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.395371:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789672769.395494:0:9975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9975:1876607738360704:0@lo:502: 00000040:00080000:2.0:1789672769.395520:0:9975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789672769.395735:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789672769.395763:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789672769.395772:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9964f53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964f5a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672769.395784:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9964f53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964f5a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672769.395794:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789672769.395797:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfc7c498000 from 6 10000000:01000000:1.0:1789672769.395807:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789672769.395974:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672769.395983:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672769.395993:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672769.396007:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46802300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738360832:0@lo:101: 00000100:00100000:1.0:1789672769.396044:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672769.396106:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc49918540 going to sleep for 11 seconds 00000100:00100000:2.0:1789672769.396201:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738360832 00000100:00100000:2.0:1789672769.396207:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738360832 00000100:00100000:2.0:1789672769.396271:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789672769.396279:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738360832:12345-0@lo:101: 00010000:00010000:2.0:1789672769.396289:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672769.396302:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8a1200/0x6c78c4f8c9964f68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964f61 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672769.396326:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8a1200/0x6c78c4f8c9964f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f61 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672769.396338:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8a1200/0x6c78c4f8c9964f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f61 expref: 19 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672769.396348:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a1200, rc 0) 00000100:00100000:2.0:1789672769.396438:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:6509:x1876607738360832:12345-0@lo:101: Request processed in 160us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672769.396445:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789672769.397055:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46802300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738360832:0@lo:101: 00010000:00010000:3.0:1789672769.397071:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964f68 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672769.397081:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964f68 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672769.397143:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738360960:0@lo:256: 00000100:00100000:3.0:1789672769.397186:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672769.397210:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc47f1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672769.397274:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738360960 00000100:00100000:0.0:1789672769.397280:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738360960 00000100:00100000:0.0:1789672769.397320:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789672769.397329:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:6509:x1876607738360960:12345-0@lo:256: 20000000:01000000:0.0:1789672769.397346:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789672769.397364:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789672769.397367:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789672769.397471:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:6509:x1876607738360960:12345-0@lo:256: Request processed in 143us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.397478:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789672769.397586:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738360960:0@lo:256: 10000000:01000000:3.0:1789672769.397644:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789672769.397651:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964f68 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672769.397682:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964f68 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672769.397690:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789672769.397693:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1789672769.397695:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789672769.397715:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c9964f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672769.397732:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c9964f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672769.397740:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c9964f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672769.397753:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738361088:0@lo:101: 00000100:00100000:3.0:1789672769.397780:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672769.397800:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc47f1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672769.401707:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738361088 00000100:00100000:0.0:1789672769.401723:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738361088 00000100:00100000:0.0:1789672769.401779:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789672769.401804:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:6509:x1876607738361088:12345-0@lo:101: 00010000:00010000:0.0:1789672769.401834:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672769.401854:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52434600/0x6c78c4f8c9964f76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964f6f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.401884:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52434600/0x6c78c4f8c9964f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f6f expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.401896:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52434600/0x6c78c4f8c9964f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f6f expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.401904:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434600, rc 0) 00000100:00100000:0.0:1789672769.401991:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738361088:12345-0@lo:101: Request processed in 190us (4210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.401999:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789672769.402267:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738361088:0@lo:101: 00010000:00010000:3.0:1789672769.402287:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c9964f6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964f76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672769.402296:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c9964f6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964f76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672769.402368:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738361216:0@lo:501: 00000100:00100000:3.0:1789672769.402414:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672769.402447:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc47f1ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789672769.402522:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738361216 00000100:00100000:1.0:1789672769.402528:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738361216 00000100:00100000:1.0:1789672769.402551:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789672769.402557:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738361216:12345-0@lo:501: 00000100:00100000:1.0:1789672769.402716:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738361216:12345-0@lo:501: Request processed in 159us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.402723:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789672769.402793:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738361216:0@lo:501: 00000100:00100000:3.0:1789672769.402818:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738361344:0@lo:503: 00000100:00100000:3.0:1789672769.402875:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672769.402899:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc47f1ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789672769.403036:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738361344 00000100:00100000:1.0:1789672769.403041:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738361344 00000100:00100000:1.0:1789672769.403058:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789672769.403063:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738361344:12345-0@lo:503: 00000100:00100000:1.0:1789672769.403151:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738361344:12345-0@lo:503: Request processed in 86us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.403158:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789672769.403345:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738361344:0@lo:503: 00000100:00100000:3.0:1789672769.403689:0:9976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9976:1876607738361472:0@lo:502: 00000100:00100000:3.0:1789672769.403733:0:9976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672769.403752:0:9976:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc47f1e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789672769.403814:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738361472 00000100:00100000:1.0:1789672769.403819:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738361472 00000100:00100000:1.0:1789672769.403869:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789672769.403876:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:9976:x1876607738361472:12345-0@lo:502: 00000100:00100000:1.0:1789672769.403961:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:9976:x1876607738361472:12345-0@lo:502: Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.403968:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789672769.404197:0:9976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9976:1876607738361472:0@lo:502: 00000020:01000000:3.0:1789672769.404224:0:9976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789672769.404233:0:9976:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789672769.404240:0:9976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672769.404242:0:9976:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789672769.404247:0:9976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789672769.404251:0:9976:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:3.0:1789672769.404274:0:9976:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789672769.404277:0:9976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789672769.404294:0:9976:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8cfb46774d40) 00000020:00000080:3.0:1789672769.404320:0:9976:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1789672769.404326:0:9976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789672769.404443:0:9976:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789672769.404450:0:9976:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789672769.404458:0:9976:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c78c4f8c9964f84 00010000:00080000:3.0:1789672769.404492:0:9976:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfb4693f000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789672769.404766:0:9976:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1789672769.405050:0:9976:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789672769.405063:0:9976:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789672769.405233:0:9976:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672769.405345:0:9976:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672769.405511:0:9976:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789672769.405601:0:9976:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789672769.413191:0:9977:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672769.413199:0:9977:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789672769.425256:0:9976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789672769.425272:0:9976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789672769.425314:0:9976:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789672769.425345:0:9976:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c78c4f8c9964f8b 00000100:00080000:2.0:1789672769.425361:0:9976:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789672769.425377:0:9976:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cfb4693f000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789672769.425445:0:9976:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfb477a2300 x1876607738361600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789672769.425477:0:9976:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1789672769.425603:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738361728:0@lo:400: 00000100:00100000:2.0:1789672769.425716:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.425766:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876607738362240:0@lo:400: 00000100:00100000:2.0:1789672769.425789:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.425815:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876607738362752:0@lo:400: 00000100:00100000:2.0:1789672769.425847:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.425866:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789672769.425872:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738362112:0@lo:400: 00000100:00100000:2.0:1789672769.425895:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.425913:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738362624:0@lo:400: 00000100:00100000:2.0:1789672769.425934:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.425966:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738361856:0@lo:400: 00000100:00100000:2.0:1789672769.425989:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.426013:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876607738362368:0@lo:400: 00000100:00100000:2.0:1789672769.426032:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.426045:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738362880:0@lo:400: 00000100:00100000:2.0:1789672769.426061:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.426074:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789672769.426079:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738361984:0@lo:400: 00000100:00100000:2.0:1789672769.426097:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.426107:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738362496:0@lo:400: 00000100:00100000:2.0:1789672769.426125:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.426165:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738362112 00000100:00100000:2.0:1789672769.426173:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738362112 00000100:00100000:2.0:1789672769.426214:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738361856 00000100:00100000:2.0:1789672769.426217:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738361856 00000100:00100000:2.0:1789672769.426231:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789672769.426239:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738362112:12345-0@lo:400: 00000100:00100000:2.0:1789672769.426295:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738362112:12345-0@lo:400: Request processed in 56us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672769.426302:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789672769.426318:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789672769.426324:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738361856:12345-0@lo:400: 00000100:00100000:2.0:1789672769.426355:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738361856:12345-0@lo:400: Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672769.426361:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789672769.426411:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738361856:0@lo:400: 00000100:00100000:2.0:1789672769.426442:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738362112:0@lo:400: 00000020:01000000:2.0:1789672769.426525:0:9976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672769.426531:0:9976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672769.426533:0:9976:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789672769.426536:0:9976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672769.426540:0:9976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672769.426541:0:9976:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789672769.426545:0:9976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789672769.426547:0:9976:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789672769.426572:0:9976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9976:1876607738363008:0@lo:502: 00000100:00100000:2.0:1789672769.426616:0:9976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.426640:0:9976:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb46884f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672769.426839:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738361600:0@lo:8: 00000100:00100000:1.0:1789672769.426875:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672769.426919:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738361728 00000100:00100000:1.0:1789672769.426924:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738361728 00000100:00100000:1.0:1789672769.426946:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738362240 00000100:00100000:1.0:1789672769.426949:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738362240 00000100:00100000:1.0:1789672769.426974:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738362752 00000100:00100000:1.0:1789672769.426977:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738362752 00000100:00100000:1.0:1789672769.426990:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738362368 00000100:00100000:1.0:1789672769.426992:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738362368 00000100:00100000:1.0:1789672769.427004:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738362880 00000100:00100000:1.0:1789672769.427007:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738362880 00000100:00100000:1.0:1789672769.427018:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738361984 00000100:00100000:1.0:1789672769.427020:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738361984 00000100:00100000:1.0:1789672769.427032:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789672769.427038:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738361728:12345-0@lo:400: 00000100:00100000:1.0:1789672769.427077:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738361728:12345-0@lo:400: Request processed in 39us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.427083:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789672769.427097:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789672769.427103:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876607738362240:12345-0@lo:400: 00000100:00100000:1.0:1789672769.427131:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876607738362240:12345-0@lo:400: Request processed in 29us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.427137:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789672769.427158:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789672769.427163:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876607738362752:12345-0@lo:400: 00000100:00100000:1.0:1789672769.427189:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876607738362752:12345-0@lo:400: Request processed in 26us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.427194:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789672769.427202:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789672769.427207:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876607738362368:12345-0@lo:400: 00000100:00100000:1.0:1789672769.427233:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876607738362368:12345-0@lo:400: Request processed in 26us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.427238:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789672769.427247:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789672769.427253:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738362880:12345-0@lo:400: 00000100:00100000:1.0:1789672769.427276:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738362880:12345-0@lo:400: Request processed in 24us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.427281:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789672769.427290:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789672769.427295:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738361984:12345-0@lo:400: 00000100:00100000:1.0:1789672769.427318:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738361984:12345-0@lo:400: Request processed in 23us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.427323:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789672769.427347:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738362624 00000100:00100000:1.0:1789672769.427350:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738362624 00000100:00100000:1.0:1789672769.427374:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738362496 00000100:00100000:1.0:1789672769.427376:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738362496 00000100:00100000:1.0:1789672769.427387:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738361600 00000100:00100000:1.0:1789672769.427389:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738361600 00000100:00100000:1.0:1789672769.427413:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789672769.427429:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738362624:12345-0@lo:400: 00000100:00100000:1.0:1789672769.427460:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738362624:12345-0@lo:400: Request processed in 32us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.427466:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789672769.427478:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789672769.427484:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738362496:12345-0@lo:400: 00000100:00100000:1.0:1789672769.427525:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738362496:12345-0@lo:400: Request processed in 42us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.427531:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789672769.427543:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789672769.427547:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876607738361600:12345-0@lo:8: 00010000:00080000:1.0:1789672769.427571:0:8428:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:1.0:1789672769.427597:0:8428:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c78c4f8c9964f92 00002000:00100000:1.0:1789672769.427609:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8cfb468c5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789672769.427613:0:8428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1789672769.427617:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789672769.427707:0:8428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789672769.427954:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789672769.427979:0:8428:0:(import.c:65:import_set_state_nolock()) ffff8cfb468c0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789672769.428022:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1876607738361600:12345-0@lo:8: Request processed in 472us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.428028:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789672769.428062:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb477a2300 x1876607738361600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789672779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672769.428074:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789672769.428081:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789672769.428095:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789672769.428100:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789672769.428102:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb4693f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789672769.428114:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789672769.428120:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738361600:0@lo:8: 00010000:00080000:1.0:1789672769.428152:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb477a1f80 x1876607738361984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672769.428163:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738361984:0@lo:400: 00010000:00080000:1.0:1789672769.428173:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7dac0000 x1876607738362496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672769.428180:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738362496:0@lo:400: 00010000:00080000:1.0:1789672769.428191:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb477a2a00 x1876607738362368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672769.428197:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876607738362368:0@lo:400: 00010000:00080000:1.0:1789672769.428210:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7dac2d80 x1876607738362880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672769.428218:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738362880:0@lo:400: 00010000:00080000:1.0:1789672769.428249:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7dac1180 x1876607738362624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672769.428257:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738362624:0@lo:400: 00010000:00080000:1.0:1789672769.428268:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb477a1880 x1876607738361728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672769.428276:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738361728:0@lo:400: 00010000:00080000:1.0:1789672769.428297:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb477a3b80 x1876607738362240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672769.428305:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876607738362240:0@lo:400: 00010000:00080000:1.0:1789672769.428316:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7dac3480 x1876607738362752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672769.428323:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876607738362752:0@lo:400: 00000100:00100000:1.0:1789672769.428390:0:9978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9978:1876607738363136:0@lo:700: 00000100:00100000:1.0:1789672769.428435:0:9978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672769.428466:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738363136 00000100:00100000:1.0:1789672769.428471:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738363136 00000100:00100000:1.0:1789672769.428504:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789672769.428511:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9978:x1876607738363136:12345-0@lo:700: 00000100:00100000:1.0:1789672769.428540:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46800000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8437:1876607738363264:0@lo:700: 00000100:00100000:1.0:1789672769.428566:0:8437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672769.428587:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b780 going to sleep for 11 seconds 00000100:00100000:1.0:1789672769.428601:0:9978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b900 going to sleep for 11 seconds 00000004:00080000:3.0:1789672769.428752:0:9977:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789672769.428807:0:9977:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 247344147511ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789672769.428813:0:9977:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:0.0:1789672769.429101:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672769.429106:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789672769.429109:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789672769.429112:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672769.429127:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738363264 00000100:00100000:0.0:1789672769.429131:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738363264 00000100:00100000:0.0:1789672769.429176:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789672769.429183:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8437:x1876607738363264:12345-0@lo:700: 00000100:00100000:0.0:1789672769.429283:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738363008 00000100:00100000:0.0:1789672769.429288:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738363008 00000100:00100000:0.0:1789672769.429358:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789672769.429366:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:9976:x1876607738363008:12345-0@lo:502: 00000100:00100000:0.0:1789672769.429507:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:9976:x1876607738363008:12345-0@lo:502: Request processed in 141us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.429523:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789672769.430107:0:9976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9976:1876607738363008:0@lo:502: 00000020:01000000:2.0:1789672769.430148:0:9976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672769.430156:0:9976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672769.430158:0:9976:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789672769.430164:0:9976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1789672769.431284:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1789672769.431314:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789672769.431325:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c9964f6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964f76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672769.431338:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c9964f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964f76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672769.431350:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789672769.431353:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfc44f3d800 from 39 10000000:01000000:1.0:1789672769.431370:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789672769.431417:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608a00/0x6c78c4f8c9964f99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672769.431425:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc61608a00/0x6c78c4f8c9964f99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672769.431435:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc61608a00/0x6c78c4f8c9964f99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672769.431454:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738363392:0@lo:101: 00000100:00100000:1.0:1789672769.431513:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672769.436431:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789672769.436629:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738363392 00000100:00100000:3.0:1789672769.436640:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738363392 00000100:00100000:3.0:1789672769.439126:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789672769.439144:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738363392:12345-0@lo:101: 00010000:00010000:3.0:1789672769.439165:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672769.439191:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d887e00/0x6c78c4f8c9964fa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964f99 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672769.439228:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d887e00/0x6c78c4f8c9964fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f99 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672769.439240:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d887e00/0x6c78c4f8c9964fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f99 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672769.439249:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887e00, rc 0) 00000100:00100000:3.0:1789672769.439905:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738363392:12345-0@lo:101: Request processed in 764us (8389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672769.439914:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789672769.444712:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738363392:0@lo:101: 00010000:00010000:1.0:1789672769.444745:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc61608a00/0x6c78c4f8c9964f99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964fa0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672769.444760:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc61608a00/0x6c78c4f8c9964f99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964fa0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672769.444867:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738363520:0@lo:501: 00000100:00100000:1.0:1789672769.444936:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 40000000:02000000:0.0:1789672769.445318:0:6519:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1789672769.448773:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738363520 00000100:00100000:2.0:1789672769.448791:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738363520 00000100:00100000:2.0:1789672769.448942:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789672769.448954:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738363520:12345-0@lo:501: 00000100:00100000:2.0:1789672769.449143:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738363520:12345-0@lo:501: Request processed in 192us (4206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672769.449151:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789672769.450619:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8437:x1876607738363264:12345-0@lo:700: Request processed in 21430us (22046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.450632:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789672769.450884:0:8437:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb46800000 x1876607738363264/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789672785 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672769.450901:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46800000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8437:1876607738363264:0@lo:700: 40000000:02000000:2.0:1789672769.450916:0:8437:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000004:00080000:0.0:1789672769.454589:0:7443:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1789672769.455296:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789672769.455338:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738363520:0@lo:501: 00000100:00100000:1.0:1789672769.455424:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738363648:0@lo:503: 00000100:00100000:1.0:1789672769.455514:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672769.455619:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789672769.455696:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738363648 00000100:00100000:3.0:1789672769.455705:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738363648 00000100:00100000:3.0:1789672769.455769:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789672769.455778:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738363648:12345-0@lo:503: 00000100:00100000:3.0:1789672769.456038:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738363648:12345-0@lo:503: Request processed in 260us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672769.456047:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789672769.456136:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738363648:0@lo:503: 00000001:00100000:0.0:1789672769.459402:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789672769.459639:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9978:x1876607738363136:12345-0@lo:700: Request processed in 31123us (31197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672769.459654:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789672769.459857:0:9978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb46801c00 x1876607738363136/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789672785 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672769.459876:0:9978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9978:1876607738363136:0@lo:700: 00000100:00100000:1.0:1789672769.460428:0:9979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9979:1876607738363776:0@lo:502: 00000100:00100000:1.0:1789672769.460490:0:9979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672769.460637:0:9979:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789672769.460780:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738363776 00000100:00100000:0.0:1789672769.460788:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738363776 00000100:00100000:0.0:1789672769.460951:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789672769.460963:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:9979:x1876607738363776:12345-0@lo:502: 00000100:00100000:0.0:1789672769.461112:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:9979:x1876607738363776:12345-0@lo:502: Request processed in 151us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.461121:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789672769.461212:0:9979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9979:1876607738363776:0@lo:502: 00000100:00100000:1.0:1789672769.461261:0:9979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9979:1876607738363904:0@lo:502: 00000100:00100000:1.0:1789672769.461314:0:9979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672769.461410:0:9979:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789672769.461486:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738363904 00000100:00100000:2.0:1789672769.461492:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738363904 00000100:00100000:2.0:1789672769.461517:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789672769.461523:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:9979:x1876607738363904:12345-0@lo:502: 00000100:00100000:2.0:1789672769.461684:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:9979:x1876607738363904:12345-0@lo:502: Request processed in 160us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672769.461691:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789672769.462049:0:9979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9979:1876607738363904:0@lo:502: 00000040:00080000:1.0:1789672769.462072:0:9979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789672769.462251:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789672769.462293:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789672769.462306:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608a00/0x6c78c4f8c9964f99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964fa0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.462319:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc61608a00/0x6c78c4f8c9964f99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964fa0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672769.462329:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789672769.462342:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfc44f3d800 from 6 10000000:01000000:0.0:1789672769.462345:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789672769.462375:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.462384:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.462471:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672769.462487:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738364032:0@lo:101: 00000100:00100000:0.0:1789672769.462618:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672769.462756:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4a763240 going to sleep for 11 seconds 00000100:00100000:3.0:1789672769.462948:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738364032 00000100:00100000:3.0:1789672769.462955:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738364032 00000100:00100000:2.0:1789672769.463017:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789672769.463029:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738364032:12345-0@lo:101: 00010000:00010000:2.0:1789672769.463050:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672769.463066:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8a1400/0x6c78c4f8c9964fae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964fa7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672769.463089:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8a1400/0x6c78c4f8c9964fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964fa7 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672769.463100:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8a1400/0x6c78c4f8c9964fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964fa7 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672769.463110:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a1400, rc 0) 00000100:00100000:2.0:1789672769.463194:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738364032:12345-0@lo:101: Request processed in 168us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672769.463201:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789672769.463333:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738364032:0@lo:101: 00010000:00010000:0.0:1789672769.463347:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964fae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.463355:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964fae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672769.463424:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738364160:0@lo:256: 00000100:00100000:0.0:1789672769.463456:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672769.463507:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4a763240 going to sleep for 11 seconds 00000100:00100000:2.0:1789672769.463601:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738364160 00000100:00100000:2.0:1789672769.463606:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738364160 00000100:00100000:2.0:1789672769.463807:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789672769.463815:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738364160:12345-0@lo:256: 20000000:01000000:2.0:1789672769.468712:0:6506:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789672769.468748:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789672769.468752:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789672769.468900:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738364160:12345-0@lo:256: Request processed in 5082us (5439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672769.468912:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789672769.469041:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738364160:0@lo:256: 10000000:01000000:0.0:1789672769.469110:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789672769.469120:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964fae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.469142:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964fae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672769.469151:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789672769.469154:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789672769.469157:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789672769.469190:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52435400/0x6c78c4f8c9964fb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.469198:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc52435400/0x6c78c4f8c9964fb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.469207:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc52435400/0x6c78c4f8c9964fb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672769.469224:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738364288:0@lo:101: 00000100:00100000:0.0:1789672769.469257:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672769.473712:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4a763240 going to sleep for 11 seconds 00000100:00100000:3.0:1789672769.476217:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738364288 00000100:00100000:3.0:1789672769.476234:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738364288 00000100:00100000:0.0:1789672769.476416:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789672769.476430:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738364288:12345-0@lo:101: 00010000:00010000:0.0:1789672769.476448:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672769.476470:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c9964fbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964fb5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.476500:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c9964fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964fb5 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.476512:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c9964fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964fb5 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672769.476542:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434200, rc 0) 00000100:00100000:0.0:1789672769.476637:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738364288:12345-0@lo:101: Request processed in 210us (7379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.476646:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789672769.476843:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738364288:0@lo:101: 00010000:00010000:3.0:1789672769.476865:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc52435400/0x6c78c4f8c9964fb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964fbc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672769.476876:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc52435400/0x6c78c4f8c9964fb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964fbc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672769.476974:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738364416:0@lo:501: 00000100:00100000:3.0:1789672769.477009:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672769.477051:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d9d2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789672769.477517:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738364416 00000100:00100000:0.0:1789672769.477525:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738364416 00000100:00100000:0.0:1789672769.477557:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789672769.477565:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738364416:12345-0@lo:501: 00000100:00100000:0.0:1789672769.477735:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738364416:12345-0@lo:501: Request processed in 171us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.477742:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789672769.478015:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738364416:0@lo:501: 00000100:00100000:3.0:1789672769.478045:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738364544:0@lo:503: 00000100:00100000:3.0:1789672769.478085:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672769.478110:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d9d2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789672769.478190:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738364544 00000100:00100000:0.0:1789672769.478196:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738364544 00000100:00100000:0.0:1789672769.478213:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789672769.478218:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738364544:12345-0@lo:503: 00000100:00100000:0.0:1789672769.478289:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738364544:12345-0@lo:503: Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.478296:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789672769.478410:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738364544:0@lo:503: 00000100:00100000:0.0:1789672769.478731:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738364672:0@lo:13: 00000100:00100000:0.0:1789672769.478762:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789672769.478796:0:9978:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789672769.478813:0:9978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9978:1876607738364800:0@lo:7: 00000100:00100000:0.0:1789672769.478852:0:9978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672769.478868:0:9978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4a763780 going to sleep for 11 seconds 00000100:00100000:2.0:1789672769.479273:0:9980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9980:1876607738364928:0@lo:502: 00000100:00100000:2.0:1789672769.479317:0:9980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.479338:0:9980:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb419ac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672769.479404:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738364928 00000100:00100000:0.0:1789672769.479416:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738364928 00000100:00100000:0.0:1789672769.479456:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789672769.479464:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:9980:x1876607738364928:12345-0@lo:502: 00000100:00100000:0.0:1789672769.479762:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:9980:x1876607738364928:12345-0@lo:502: Request processed in 298us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.479769:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789672769.479923:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738364672 00000100:00100000:1.0:1789672769.479928:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738364672 00000100:00100000:1.0:1789672769.479968:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789672769.479977:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738364672:12345-0@lo:13: 00002000:00000024:1.0:1789672769.479999:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789672769.480201:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738364672:12345-0@lo:13: Request processed in 224us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.480208:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789672769.480229:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738364800 00000100:00100000:1.0:1789672769.480234:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738364800 00000100:00100000:1.0:1789672769.480264:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789672769.480271:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9978:x1876607738364800:12345-0@lo:7: 00000100:00100000:3.0:1789672769.486123:0:9980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9980:1876607738364928:0@lo:502: 00000020:01000000:3.0:1789672769.486177:0:9980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789672769.486186:0:9980:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789672769.486194:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672769.486197:0:9980:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789672769.486203:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789672769.486207:0:9980:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:3.0:1789672769.486238:0:9980:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789672769.486241:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789672769.486257:0:9980:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cfb46770000) 00000020:00000080:3.0:1789672769.486282:0:9980:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1789672769.486287:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789672769.486399:0:9980:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789672769.486406:0:9980:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789672769.486416:0:9980:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c78c4f8c9964fca 00010000:00080000:3.0:1789672769.486448:0:9980:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfb4693b000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789672769.487108:0:9980:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1789672769.487243:0:9980:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789672769.487258:0:9980:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789672769.487429:0:9980:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:0.0:1789672769.487804:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47a2aa00 x1876607738364672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672769.487839:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738364672:0@lo:13: 00000040:00080000:3.0:1789672769.487987:0:9980:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789672769.488095:0:9980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789672769.488166:0:9980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789672769.490764:0:9981:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672769.490773:0:9981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789672769.492131:0:9980:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789672769.492148:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789672769.492188:0:9980:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789672769.492216:0:9980:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c78c4f8c9964fd1 00000100:00080000:3.0:1789672769.492227:0:9980:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789672769.492238:0:9980:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfb4693b000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789672769.492281:0:9980:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfb4744c000 x1876607738365056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789672769.492302:0:9980:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00002000:00080000:1.0:1789672769.493464:0:8428:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789672769.493473:0:8428:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000020:01000000:3.0:1789672769.493735:0:9980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789672769.493741:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672769.493743:0:9980:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789672769.493747:0:9980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789672769.493751:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672769.493753:0:9980:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789672769.493756:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789672769.493758:0:9980:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789672769.493794:0:9980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9980:1876607738365184:0@lo:502: 00000100:00100000:3.0:1789672769.493870:0:9980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672769.493910:0:9980:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc431719c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672769.494009:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9978:x1876607738364800:12345-0@lo:7: Request processed in 13736us (15153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.494020:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789672769.494239:0:9978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47a2b100 x1876607738364800/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789672785 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672769.494254:0:9978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9978:1876607738364800:0@lo:7: 00000004:00080000:3.0:1789672769.494268:0:9978:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789672769.494306:0:9978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9978:1876607738365312:0@lo:5: 00000100:00100000:3.0:1789672769.494331:0:9978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672769.494356:0:9978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43171d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672769.494428:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738365056:0@lo:8: 00000100:00100000:0.0:1789672769.494463:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672769.494501:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738365312 00000100:00100000:0.0:1789672769.494508:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738365312 00000100:00100000:0.0:1789672769.494562:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738365056 00000100:00100000:0.0:1789672769.494565:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738365056 00000100:00100000:0.0:1789672769.494580:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789672769.494588:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9978:x1876607738365312:12345-0@lo:5: 00002000:00080000:0.0:1789672769.494612:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789672769.494645:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9978:x1876607738365312:12345-0@lo:5: Request processed in 57us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.494651:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789672769.494695:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789672769.494701:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1876607738365056:12345-0@lo:8: 00010000:00080000:0.0:1789672769.494728:0:8430:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:0.0:1789672769.494752:0:8430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c78c4f8c9964fd8 00002000:00100000:0.0:1789672769.494765:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cfb45b3a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789672769.494778:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789672769.494780:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789672769.494855:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789672769.494880:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8cfb45b38000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789672769.494919:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1876607738365056:12345-0@lo:8: Request processed in 217us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.494926:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789672769.494954:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb4744c000 x1876607738365056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789672779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672769.494963:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789672769.494970:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789672769.494976:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789672769.494981:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789672769.494984:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb4693b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789672769.494995:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789672769.495000:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738365056:0@lo:8: 00010000:00080000:0.0:1789672769.495026:0:9978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb4744d500 x1876607738365312/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789672785 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672769.495034:0:9978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9978:1876607738365312:0@lo:5: 00000004:00080000:0.0:1789672769.495044:0:9978:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789672769.495068:0:9978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a28a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9978:1876607738365440:0@lo:5: 00000100:00100000:0.0:1789672769.495090:0:9978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672769.495103:0:9978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb419de180 going to sleep for 11 seconds 00000100:00100000:0.0:1789672769.495115:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738365440 00000100:00100000:0.0:1789672769.495118:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738365440 00000100:00100000:0.0:1789672769.495154:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789672769.495167:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9978:x1876607738365440:12345-0@lo:5: 00002000:00080000:0.0:1789672769.495205:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1789672769.496792:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9978:x1876607738365440:12345-0@lo:5: Request processed in 1621us (1696us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789672769.496800:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789672769.496978:0:9978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47a28a80 x1876607738365440/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789672785 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672769.496993:0:9978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a28a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9978:1876607738365440:0@lo:5: 00000004:00080000:0.0:1789672769.497007:0:9978:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789672769.497042:0:9978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9978:1876607738365568:0@lo:900: 00000100:00100000:0.0:1789672769.497074:0:9978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672769.497093:0:9978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb419de180 going to sleep for 11 seconds 00000004:00080000:0.0:1789672769.497109:0:9981:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789672769.497165:0:9981:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 247412505871ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789672769.497172:0:9981:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789672769.500789:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738365568 00000100:00100000:1.0:1789672769.500806:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738365568 00000100:00100000:1.0:1789672769.500884:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789672769.500896:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9978:x1876607738365568:12345-0@lo:900: 00000100:00100000:1.0:1789672769.501000:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9978:x1876607738365568:12345-0@lo:900: Request processed in 106us (3925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.501008:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789672769.501052:0:9978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47a2ad80 x1876607738365568/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789672785 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672769.501066:0:9978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9978:1876607738365568:0@lo:900: 00000100:00100000:2.0:1789672769.501248:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738365184 00000100:00100000:2.0:1789672769.501270:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738365184 00000100:00100000:2.0:1789672769.501348:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789672769.501357:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:9980:x1876607738365184:12345-0@lo:502: 00000100:00100000:2.0:1789672769.501488:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:9980:x1876607738365184:12345-0@lo:502: Request processed in 132us (7617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672769.501495:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789672769.501597:0:9980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:9980:1876607738365184:0@lo:502: 00000020:01000000:3.0:1789672769.501625:0:9980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789672769.501632:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672769.501634:0:9980:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789672769.501639:0:9980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1789672769.501721:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1789672769.501740:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789672769.501751:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52435400/0x6c78c4f8c9964fb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964fbc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672769.501762:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc52435400/0x6c78c4f8c9964fb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964fbc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672769.501773:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789672769.501775:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cfc499cb380 from 1 10000000:01000000:3.0:1789672769.501778:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789672769.501808:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9964fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672769.501849:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9964fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672769.501858:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9964fdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672769.501878:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738365696:0@lo:101: 00000100:00100000:3.0:1789672769.501913:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789672769.503705:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789672769.506256:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc431719c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672769.507288:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738365696 00000100:00100000:1.0:1789672769.507300:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738365696 00000100:00100000:1.0:1789672769.511746:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789672769.511763:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738365696:12345-0@lo:101: 00010000:00010000:1.0:1789672769.511784:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672769.511804:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc61608800/0x6c78c4f8c9964fe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9964fdf expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672769.511839:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc61608800/0x6c78c4f8c9964fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9964fdf expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672769.511852:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc61608800/0x6c78c4f8c9964fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964fdf expref: 24 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672769.511862:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc61608800, rc 0) 00000100:00100000:1.0:1789672769.511947:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738365696:12345-0@lo:101: Request processed in 189us (10032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.511954:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789672769.512100:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738365696:0@lo:101: 00010000:00010000:3.0:1789672769.512125:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9964fdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964fe6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672769.512135:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9964fdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964fe6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672769.512218:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738365824:0@lo:501: 00000100:00100000:3.0:1789672769.512252:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672769.512285:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc431719c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672769.512300:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738365824 00000100:00100000:3.0:1789672769.512306:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738365824 00000100:00100000:3.0:1789672769.512350:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789672769.512357:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738365824:12345-0@lo:501: 00000100:00100000:3.0:1789672769.512453:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738365824:12345-0@lo:501: Request processed in 96us (200us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789672769.512460:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789672769.512498:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738365824:0@lo:501: 10000000:01000000:3.0:1789672769.512544:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789672769.512551:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9964fdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964fe6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672769.512559:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9964fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964fe6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789672769.514313:0:9982:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789672769.514350:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9982:1876607738366080:0@lo:7: 00000100:00100000:1.0:1789672769.514439:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672769.514475:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672769.514521:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672769.514546:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738365952:0@lo:13: 00000100:00100000:3.0:1789672769.514580:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672769.514830:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738366080 00000100:00100000:0.0:1789672769.514838:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738366080 00000100:00100000:0.0:1789672769.514897:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789672769.514906:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9982:x1876607738366080:12345-0@lo:7: 00000100:00080000:2.0:1789672769.515652:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789672769.517735:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738365952 00000100:00100000:1.0:1789672769.517748:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738365952 00000100:00100000:1.0:1789672769.517797:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789672769.517807:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1876607738365952:12345-0@lo:13: 00002000:00000024:1.0:1789672769.517829:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:1.0:1789672769.517910:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1876607738365952:12345-0@lo:13: Request processed in 104us (3328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.517917:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789672769.518047:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb46801880 x1876607738365952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672769.518070:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738365952:0@lo:13: 00002000:00080000:0.0:1789672769.521297:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789672769.521308:0:8430:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789672769.521484:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9982:x1876607738366080:12345-0@lo:7: Request processed in 6575us (7040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672769.521497:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789672769.524628:0:9982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb46801c00 x1876607738366080/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789672785 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672769.524651:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9982:1876607738366080:0@lo:7: 00000004:00080000:1.0:1789672769.524805:0:9982:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789672769.525949:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9982:1876607738366208:0@lo:5: 00000100:00100000:2.0:1789672769.526031:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672769.526116:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb419ac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672769.528596:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738366208 00000100:00100000:1.0:1789672769.528612:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738366208 00000100:00100000:2.0:1789672769.528903:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789672769.528915:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9982:x1876607738366208:12345-0@lo:5: 00002000:00080000:2.0:1789672769.528952:0:8429:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789672769.528956:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1789672769.532962:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:1.0:1789672769.532984:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1789672769.532990:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789672769.533286:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9982:x1876607738366208:12345-0@lo:5: Request processed in 4369us (7249us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789672769.533299:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789672769.533388:0:9982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8dd500 x1876607738366208/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789672785 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672769.533428:0:9982:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789672769.533435:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9982:1876607738366208:0@lo:5: 00000004:00080000:0.0:1789672769.533452:0:9982:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789672769.533514:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9982:1876607738366336:0@lo:700: 00000100:00100000:0.0:1789672769.533622:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672769.533652:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672769.533741:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738366336 00000100:00100000:1.0:1789672769.533748:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738366336 00000100:00100000:1.0:1789672769.533867:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789672769.533878:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9982:x1876607738366336:12345-0@lo:700: 00000100:00100000:1.0:1789672769.543312:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9982:x1876607738366336:12345-0@lo:700: Request processed in 9424us (9678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672769.543356:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789672769.543475:0:9982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47a2b480 x1876607738366336/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789672785 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672769.543491:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9982:1876607738366336:0@lo:700: 00000004:02000040:0.0:1789672769.545008:0:9982:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1789672769.548969:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9982:1876607738366464:0@lo:5: 00000100:00100000:0.0:1789672769.549042:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672769.549167:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789672769.551185:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738366464 00000100:00100000:3.0:1789672769.551198:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738366464 00000100:00100000:3.0:1789672769.551257:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789672769.551268:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9982:x1876607738366464:12345-0@lo:5: 00002000:00080000:3.0:1789672769.557067:0:8494:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789672769.557090:0:8494:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1789672769.561053:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9982:x1876607738366464:12345-0@lo:5: Request processed in 9779us (12003us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789672769.561068:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789672769.561184:0:9982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47a2b480 x1876607738366464/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789672785 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672769.561205:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9982:1876607738366464:0@lo:5: 00000004:00080000:0.0:1789672769.561221:0:9982:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:3.0:1789672769.738161:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789672770.188596:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1789672770.756898:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789672771.043883:0:10032:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789672771.044915:0:10032:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789672771.395912:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672771.395943:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738366592:0@lo:13: 00000100:00100000:2.0:1789672771.396013:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672771.396283:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738366592 00000100:00100000:3.0:1789672771.396293:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738366592 00000100:00100000:3.0:1789672771.396372:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789672771.396383:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738366592:12345-0@lo:13: 00002000:00000024:3.0:1789672771.396420:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672771.396466:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738366592:12345-0@lo:13: Request processed in 86us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672771.396473:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1789672771.396594:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789672771.396626:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb4744d180 x1876607738366592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672771.396645:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738366592:0@lo:13: 00000100:00100000:2.0:1789672771.396862:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672771.396880:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738366720:0@lo:13: 00000100:00100000:2.0:1789672771.396909:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672771.396943:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738366720 00000100:00100000:2.0:1789672771.396947:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738366720 00000100:00100000:2.0:1789672771.396975:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789672771.396981:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738366720:12345-0@lo:13: 00002000:00000024:2.0:1789672771.396991:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672771.397020:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738366720:12345-0@lo:13: Request processed in 39us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672771.397026:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789672771.397041:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789672771.397057:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8dc380 x1876607738366720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672771.397070:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738366720:0@lo:13: 00010000:00010000:3.0:1789672771.786761:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789672771.877455:0:10080:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789672771.877465:0:10080:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1789672772.420167:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789672772.420198:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738366848:0@lo:41: 00000100:00100000:1.0:1789672772.420284:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672772.420701:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738366848 00000100:00100000:3.0:1789672772.420712:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738366848 00000100:00100000:3.0:1789672772.420774:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789672772.420783:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738366848:12345-0@lo:41: 00000004:00000024:3.0:1789672772.420823:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789672772.420889:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738366848:12345-0@lo:41: Request processed in 107us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672772.420896:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789672772.420981:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738366848:0@lo:41: 00000100:00100000:0.0:1789672772.520842:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672772.520939:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714197632 00000100:00100000:3.0:1789672772.520951:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714197632 00000100:00100000:3.0:1789672772.521006:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 182 00000100:00100000:3.0:1789672772.521015:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2394:x1876607714197632:12345-192.168.201.50@tcp:250: 00010000:00080000:3.0:1789672772.521046:0:6504:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6e362d29-d6a4-4e54-8405-94913e6a9c61@192.168.201.50@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:3.0:1789672772.521083:0:6504:0:(genops.c:1384:class_connect()) connect: client 6e362d29-d6a4-4e54-8405-94913e6a9c61, cookie 0x6c78c4f8c9964fed 00000100:00080000:3.0:1789672772.521237:0:6504:0:(import.c:65:import_set_state_nolock()) ffff8cfb4693e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789672772.521310:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+5:2394:x1876607714197632:12345-192.168.201.50@tcp:250: Request processed in 293us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672772.521317:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 182 00000100:00100000:0.0:1789672772.540436:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672772.540546:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714197760 00000100:00100000:2.0:1789672772.540557:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714197760 00000100:00100000:2.0:1789672772.540619:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 183 00000100:00100000:2.0:1789672772.540632:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+5:6157:x1876607714197760:12345-192.168.201.50@tcp:101: 00010000:00010000:2.0:1789672772.540651:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672772.540712:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8a0c00/0x6c78c4f8c9964ff4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24e8a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672772.540741:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8a0c00/0x6c78c4f8c9964ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e8a expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672772.540752:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8a0c00/0x6c78c4f8c9964ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e8a expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672772.540782:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a0c00, rc 0) 00000100:00100000:2.0:1789672772.540838:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+6:6157:x1876607714197760:12345-192.168.201.50@tcp:101: Request processed in 210us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672772.540845:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 183 00000100:00100000:2.0:1789672772.542881:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672772.542962:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714197888 00000100:00100000:1.0:1789672772.542972:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714197888 00000100:00100000:1.0:1789672772.543022:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 184 00000100:00100000:1.0:1789672772.543031:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+6:6157:x1876607714197888:12345-192.168.201.50@tcp:501: 00000100:00100000:1.0:1789672772.543148:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+6:6157:x1876607714197888:12345-192.168.201.50@tcp:501: Request processed in 117us (274us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789672772.543156:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 184 00000100:00100000:0.0:1789672772.560785:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672772.560869:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714198016 00000100:00100000:3.0:1789672772.560879:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714198016 00000100:00100000:3.0:1789672772.560932:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 185 00000100:00100000:3.0:1789672772.560942:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+6:6157:x1876607714198016:12345-192.168.201.50@tcp:101: 00010000:00010000:3.0:1789672772.560971:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672772.560988:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d887800/0x6c78c4f8c9964ffb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24e91 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672772.561015:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d887800/0x6c78c4f8c9964ffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e91 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672772.561027:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d887800/0x6c78c4f8c9964ffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e91 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672772.561036:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887800, rc 0) 00000100:00100000:3.0:1789672772.561090:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+7:6157:x1876607714198016:12345-192.168.201.50@tcp:101: Request processed in 150us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672772.561097:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 185 00000100:00100000:0.0:1789672772.564754:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672772.564909:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714198144 00000100:00100000:2.0:1789672772.564919:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714198144 00000100:00100000:2.0:1789672772.564978:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 186 00000100:00100000:2.0:1789672772.564989:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+7:6157:x1876607714198144:12345-192.168.201.50@tcp:501: 00000100:00100000:2.0:1789672772.565144:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+8:6157:x1876607714198144:12345-192.168.201.50@tcp:501: Request processed in 156us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672772.565153:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 186 00000100:00100000:2.0:1789672772.571797:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672772.571889:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714198272 00000100:00100000:1.0:1789672772.571900:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714198272 00000100:00100000:1.0:1789672772.571956:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 187 00000100:00100000:1.0:1789672772.571967:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+8:6157:x1876607714198272:12345-192.168.201.50@tcp:503: 00000100:00100000:1.0:1789672772.572124:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+8:6157:x1876607714198272:12345-192.168.201.50@tcp:503: Request processed in 158us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672772.572132:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 187 00000100:00100000:0.0:1789672772.589536:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672772.589644:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714198400 00000100:00100000:3.0:1789672772.589691:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714198400 00000100:00100000:3.0:1789672772.589755:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 188 00000100:00100000:3.0:1789672772.589766:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+8:6176:x1876607714198400:12345-192.168.201.50@tcp:502: 00000100:00100000:3.0:1789672772.589935:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+8:6176:x1876607714198400:12345-192.168.201.50@tcp:502: Request processed in 170us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672772.589944:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 188 00000100:00100000:0.0:1789672772.641291:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672772.641464:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714198528 00000100:00100000:2.0:1789672772.641476:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714198528 00000100:00100000:2.0:1789672772.641538:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 189 00000100:00100000:2.0:1789672772.641552:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+8:6176:x1876607714198528:12345-192.168.201.50@tcp:502: 00000100:00100000:2.0:1789672772.641762:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+8:6176:x1876607714198528:12345-192.168.201.50@tcp:502: Request processed in 214us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672772.641770:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 189 00000100:00100000:2.0:1789672772.646009:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672772.646174:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714198656 00000100:00100000:3.0:1789672772.646186:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714198656 00000100:00100000:3.0:1789672772.646246:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 190 00000100:00100000:3.0:1789672772.646258:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+8:6157:x1876607714198656:12345-192.168.201.50@tcp:101: 00010000:00010000:3.0:1789672772.646277:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672772.646309:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d886e00/0x6c78c4f8c9965002 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24ec2 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672772.646371:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d886e00/0x6c78c4f8c9965002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ec2 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672772.646383:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d886e00/0x6c78c4f8c9965002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ec2 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672772.646393:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886e00, rc 0) 00000100:00100000:3.0:1789672772.646459:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:6157:x1876607714198656:12345-192.168.201.50@tcp:101: Request processed in 202us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672772.646466:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 190 00000100:00100000:0.0:1789672772.651883:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672772.652132:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714198784 00000100:00100000:1.0:1789672772.652143:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714198784 00000100:00100000:1.0:1789672772.652203:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 191 00000100:00100000:1.0:1789672772.652214:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:6157:x1876607714198784:12345-192.168.201.50@tcp:256: 20000000:01000000:1.0:1789672772.652240:0:6507:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789672772.652265:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789672772.652274:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789672772.652277:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789672772.652365:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789672772.652370:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789672772.659721:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:6157:x1876607714198784:12345-192.168.201.50@tcp:256: Request processed in 7496us (7836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672772.659737:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 191 00000100:00100000:2.0:1789672772.662745:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672772.662884:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714198912 00000100:00100000:0.0:1789672772.662896:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714198912 00000100:00100000:0.0:1789672772.662958:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 192 00000100:00100000:0.0:1789672772.662969:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:6157:x1876607714198912:12345-192.168.201.50@tcp:101: 00010000:00010000:0.0:1789672772.662985:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672772.663004:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc40031000/0x6c78c4f8c9965009 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24ec9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672772.663044:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc40031000/0x6c78c4f8c9965009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ec9 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672772.663056:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc40031000/0x6c78c4f8c9965009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ec9 expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672772.663065:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc40031000, rc 0) 00000100:00100000:0.0:1789672772.663124:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6157:x1876607714198912:12345-192.168.201.50@tcp:101: Request processed in 156us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672772.663131:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 192 00000100:00100000:0.0:1789672772.668728:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672772.669450:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714199040 00000100:00100000:1.0:1789672772.669463:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714199040 00000100:00100000:1.0:1789672772.669537:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 193 00000100:00100000:1.0:1789672772.669547:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6157:x1876607714199040:12345-192.168.201.50@tcp:501: 00000100:00100000:1.0:1789672772.669756:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6157:x1876607714199040:12345-192.168.201.50@tcp:501: Request processed in 209us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672772.669764:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 193 00000100:00100000:2.0:1789672772.674493:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672772.674651:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714199168 00000100:00100000:3.0:1789672772.674688:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714199168 00000100:00100000:3.0:1789672772.674743:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 194 00000100:00100000:3.0:1789672772.674753:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6157:x1876607714199168:12345-192.168.201.50@tcp:503: 00000100:00100000:3.0:1789672772.674899:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6157:x1876607714199168:12345-192.168.201.50@tcp:503: Request processed in 147us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672772.674907:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 194 00000100:00100000:2.0:1789672772.681773:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672772.681916:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714199296 00000100:00100000:0.0:1789672772.681927:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714199296 00000100:00100000:0.0:1789672772.681991:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 195 00000100:00100000:0.0:1789672772.682002:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6178:x1876607714199296:12345-192.168.201.50@tcp:502: 00000100:00100000:0.0:1789672772.682176:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6178:x1876607714199296:12345-192.168.201.50@tcp:502: Request processed in 175us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672772.682194:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 195 00000100:00100000:0.0:1789672772.685096:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672772.686755:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714199424 00000100:00100000:1.0:1789672772.686769:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714199424 00000100:00100000:1.0:1789672772.686875:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 196 00000100:00100000:1.0:1789672772.686886:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6178:x1876607714199424:12345-192.168.201.50@tcp:502: 00000100:00100000:1.0:1789672772.687065:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6178:x1876607714199424:12345-192.168.201.50@tcp:502: Request processed in 180us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672772.687074:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 196 00000100:00100000:2.0:1789672772.697248:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672772.697314:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672772.697422:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714199552 00000100:00100000:3.0:1789672772.697432:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714199552 00000100:00100000:3.0:1789672772.697477:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714199808 00000100:00100000:3.0:1789672772.697481:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714199808 00000100:00100000:3.0:1789672772.697507:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:3.0:1789672772.697515:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1876607714199552:12345-192.168.201.50@tcp:38: 00010000:00080000:3.0:1789672772.697547:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:3.0:1789672772.697616:0:6514:0:(genops.c:1384:class_connect()) connect: client ad795a16-0aa4-4e04-82a0-6f12aab5f2ea, cookie 0x6c78c4f8c9965010 00000004:00100000:3.0:1789672772.697653:0:6514:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789672772.697922:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f578000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789672772.697989:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2394:x1876607714199552:12345-192.168.201.50@tcp:38: Request processed in 473us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672772.697997:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:3.0:1789672772.698016:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:3.0:1789672772.698021:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1876607714199808:12345-192.168.201.50@tcp:38: 00010000:00080000:3.0:1789672772.698037:0:6514:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:3.0:1789672772.698079:0:6514:0:(genops.c:1384:class_connect()) connect: client ad795a16-0aa4-4e04-82a0-6f12aab5f2ea, cookie 0x6c78c4f8c9965017 00000004:00100000:3.0:1789672772.698092:0:6514:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789672772.698242:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f57c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789672772.698266:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2394:x1876607714199808:12345-192.168.201.50@tcp:38: Request processed in 242us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672772.698272:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 8 00010000:00010000:0.0:1789672772.807790:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672773.444294:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789672773.444352:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738366976:0@lo:41: 00000100:00100000:1.0:1789672773.444441:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672773.444497:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738366976 00000100:00100000:0.0:1789672773.444507:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738366976 00000100:00100000:0.0:1789672773.444557:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789672773.444567:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738366976:12345-0@lo:41: 00000004:00000024:0.0:1789672773.444600:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789672773.444688:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738366976:12345-0@lo:41: Request processed in 122us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672773.444695:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789672773.445216:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738366976:0@lo:41: 00000100:00100000:0.0:1789672773.725858:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672773.725907:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672773.725993:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714199936 00000100:00100000:1.0:1789672773.726004:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714199936 00000100:00100000:1.0:1789672773.726098:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714199680 00000100:00100000:1.0:1789672773.726103:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714199680 00000100:00100000:1.0:1789672773.726129:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:1.0:1789672773.726140:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:0:x1876607714199936:12345-192.168.201.50@tcp:41: 00000004:00000024:1.0:1789672773.726177:0:9524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789672773.726233:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:0:x1876607714199936:12345-192.168.201.50@tcp:41: Request processed in 96us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672773.726241:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:1.0:1789672773.726256:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:1.0:1789672773.726262:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:0:x1876607714199680:12345-192.168.201.50@tcp:41: 00000004:00000024:1.0:1789672773.726272:0:9524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789672773.726292:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:0:x1876607714199680:12345-192.168.201.50@tcp:41: Request processed in 31us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672773.726297:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00080000:0.0:1789672773.726376:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672773.726381:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789672773.735194:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672773.735290:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714200064 00000100:00100000:1.0:1789672773.735301:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714200064 00000100:00100000:1.0:1789672773.735388:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:1.0:1789672773.735399:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:6157:x1876607714200064:12345-192.168.201.50@tcp:41: 00000004:00000024:1.0:1789672773.735430:0:9524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789672773.735511:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:6157:x1876607714200064:12345-192.168.201.50@tcp:41: Request processed in 114us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672773.735519:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:2.0:1789672773.738236:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672773.738334:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714200192 00000100:00100000:1.0:1789672773.738355:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714200192 00000100:00100000:1.0:1789672773.741302:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:1.0:1789672773.741344:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:6157:x1876607714200192:12345-192.168.201.50@tcp:40: 00000100:00100000:1.0:1789672773.741487:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:6157:x1876607714200192:12345-192.168.201.50@tcp:40: Request processed in 169us (3260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672773.741496:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:0.0:1789672773.749783:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672773.751993:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672773.752034:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672773.752070:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672773.752118:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714200320 00000100:00100000:3.0:1789672773.752128:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714200320 00000100:00100000:3.0:1789672773.752161:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714200448 00000100:00100000:3.0:1789672773.752164:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714200448 00000100:00100000:3.0:1789672773.752182:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:3.0:1789672773.752191:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1876607714200320:12345-192.168.201.50@tcp:8: 00010000:00080000:3.0:1789672773.752228:0:8429:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:3.0:1789672773.752258:0:8429:0:(genops.c:1384:class_connect()) connect: client ad795a16-0aa4-4e04-82a0-6f12aab5f2ea, cookie 0x6c78c4f8c996501e 00002000:00100000:3.0:1789672773.752273:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ad795a16-0aa4-4e04-82a0-6f12aab5f2ea/ffff8cfc7f57f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789672773.752294:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789672773.752380:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:1.0:1789672773.752387:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1876607714200448:12345-192.168.201.50@tcp:8: 00010000:00080000:1.0:1789672773.752404:0:8428:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:1.0:1789672773.752427:0:8428:0:(genops.c:1384:class_connect()) connect: client ad795a16-0aa4-4e04-82a0-6f12aab5f2ea, cookie 0x6c78c4f8c9965025 00002000:00100000:1.0:1789672773.752433:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ad795a16-0aa4-4e04-82a0-6f12aab5f2ea/ffff8cfb47a08800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789672773.752444:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789672773.753963:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789672773.754025:0:8428:0:(import.c:65:import_set_state_nolock()) ffff8cfb47a0e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789672773.754103:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2394:x1876607714200448:12345-192.168.201.50@tcp:8: Request processed in 1712us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672773.754112:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:0.0:1789672773.754519:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714200704 00000100:00100000:0.0:1789672773.754530:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714200704 00000100:00100000:0.0:1789672773.754587:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 197 00000100:00100000:0.0:1789672773.754596:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2395:x1876607714200704:12345-192.168.201.50@tcp:400: 00000100:00100000:0.0:1789672773.754631:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2395:x1876607714200704:12345-192.168.201.50@tcp:400: Request processed in 37us (2646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672773.754647:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 197 00002000:00080000:3.0:1789672773.755626:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789672773.756049:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f57c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789672773.756105:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2394:x1876607714200320:12345-192.168.201.50@tcp:8: Request processed in 3912us (4068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672773.756114:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:2.0:1789672773.756219:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714200576 00000100:00100000:2.0:1789672773.756229:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714200576 00000100:00100000:2.0:1789672773.756281:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:2.0:1789672773.756291:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:6157:x1876607714200576:12345-192.168.201.50@tcp:900: 00000100:00100000:2.0:1789672773.756355:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:6157:x1876607714200576:12345-192.168.201.50@tcp:900: Request processed in 55us (6575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672773.756362:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:3.0:1789672773.766741:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672773.766902:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714200832 00000100:00100000:0.0:1789672773.766917:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714200832 00000100:00100000:0.0:1789672773.766984:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:0.0:1789672773.767136:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:6157:x1876607714200832:12345-192.168.201.50@tcp:33: 00000004:00080000:1.0:1789672773.819743:0:6515:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 52507us 00010000:00010000:3.0:1789672773.827832:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:0.0:1789672773.873607:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789672773.873760:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:6157:x1876607714200832:12345-192.168.201.50@tcp:33: Request processed in 106745us (107023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672773.873772:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:0.0:1789672774.094913:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672774.095239:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714200960 00000100:00100000:1.0:1789672774.095252:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714200960 00000100:00100000:1.0:1789672774.095334:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:1.0:1789672774.095345:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:6195:x1876607714200960:12345-192.168.201.50@tcp:101: 00010000:00010000:1.0:1789672774.095368:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672774.095436:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609000/0x6c78c4f8c996502c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24efa expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672774.095515:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c9965033 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672774.095543:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c9965033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672774.095559:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c9965033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672774.095607:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789672774.095611:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789672774.095627:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c9965033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672774.095654:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609000/0x6c78c4f8c996502c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24efa expref: 8 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672774.095718:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c9965033 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24efa expref: 7 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672774.095727:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc821d4300) 00010000:00010000:1.0:1789672774.095729:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672774.095733:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc61609600, rc 0) 00000100:00100000:1.0:1789672774.095796:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:6195:x1876607714200960:12345-192.168.201.50@tcp:101: Request processed in 452us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672774.095804:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00010000:00010000:0.0:1789672774.852134:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672774.980163:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672774.980191:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738367104:0@lo:13: 00000100:00100000:0.0:1789672774.980325:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672774.980515:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738367104 00000100:00100000:3.0:1789672774.980524:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738367104 00000100:00100000:3.0:1789672774.980589:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789672774.980600:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738367104:12345-0@lo:13: 00002000:00000024:3.0:1789672774.980624:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672774.980694:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738367104:12345-0@lo:13: Request processed in 96us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672774.980700:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789672774.980970:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789672774.981005:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7dac3480 x1876607738367104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672774.981016:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789672774.981046:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738367104:0@lo:13: 00000100:00100000:0.0:1789672774.981728:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738367232:0@lo:13: 00000100:00100000:0.0:1789672774.981769:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672774.981799:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738367744:0@lo:400: 00000100:00100000:0.0:1789672774.981823:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672774.981840:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738368256:0@lo:400: 00000100:00100000:0.0:1789672774.981862:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672774.981880:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738368768:0@lo:400: 00000100:00100000:0.0:1789672774.981897:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672774.981913:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789672774.981918:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738367360:0@lo:400: 00000100:00100000:0.0:1789672774.981959:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672774.981981:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738367872:0@lo:400: 00000100:00100000:3.0:1789672774.982006:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738367616:0@lo:400: 00000100:00100000:0.0:1789672774.982014:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672774.982032:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738368384:0@lo:400: 00000100:00100000:3.0:1789672774.982035:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672774.982051:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672774.982052:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738368128:0@lo:400: 00000100:00100000:3.0:1789672774.982070:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672774.982075:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738368256 00000100:00100000:0.0:1789672774.982081:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738368256 00000100:00100000:3.0:1789672774.982082:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876607738368640:0@lo:400: 00000100:00100000:3.0:1789672774.982103:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672774.982117:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789672774.982117:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738368768 00000100:00100000:0.0:1789672774.982120:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738368768 00000100:00100000:3.0:1789672774.982122:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738367488:0@lo:400: 00000100:00100000:0.0:1789672774.982134:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738368384 00000100:00100000:0.0:1789672774.982136:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738368384 00000100:00100000:3.0:1789672774.982139:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672774.982150:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789672774.982156:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738368256:12345-0@lo:400: 00000100:00100000:3.0:1789672774.982167:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876607738368000:0@lo:400: 00000100:00100000:3.0:1789672774.982189:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672774.982207:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876607738368512:0@lo:400: 00000100:00100000:0.0:1789672774.982210:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738368256:12345-0@lo:400: Request processed in 54us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672774.982216:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789672774.982230:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789672774.982235:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738368768:12345-0@lo:400: 00000100:00100000:3.0:1789672774.982240:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672774.982259:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738368768:12345-0@lo:400: Request processed in 24us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672774.982260:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738367744 00000100:00100000:3.0:1789672774.982263:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738367744 00000100:00100000:0.0:1789672774.982264:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789672774.982274:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789672774.982279:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738368384:12345-0@lo:400: 00000100:00100000:3.0:1789672774.982281:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738368128 00000100:00100000:3.0:1789672774.982283:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738368128 00000100:00100000:3.0:1789672774.982307:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738368640 00000100:00100000:3.0:1789672774.982310:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738368640 00000100:00100000:0.0:1789672774.982315:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738368384:12345-0@lo:400: Request processed in 37us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672774.982321:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789672774.982323:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738367488 00000100:00100000:3.0:1789672774.982325:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738367488 00000100:00100000:3.0:1789672774.982335:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738368000 00000100:00100000:0.0:1789672774.982336:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738367872 00000100:00100000:3.0:1789672774.982337:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738368000 00000100:00100000:0.0:1789672774.982344:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738367872 00000100:00100000:3.0:1789672774.982347:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738368512 00000100:00100000:3.0:1789672774.982349:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738368512 00000100:00100000:0.0:1789672774.982366:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738367616 00000100:00100000:0.0:1789672774.982369:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738367616 00000100:00100000:0.0:1789672774.982380:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789672774.982385:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738367872:12345-0@lo:400: 00000100:00100000:3.0:1789672774.982440:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789672774.982447:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738367744:12345-0@lo:400: 00000100:00100000:3.0:1789672774.982478:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738367744:12345-0@lo:400: Request processed in 32us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672774.982484:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789672774.982496:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789672774.982502:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738368128:12345-0@lo:400: 00000100:00100000:3.0:1789672774.982533:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738368128:12345-0@lo:400: Request processed in 31us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672774.982538:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789672774.982550:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789672774.982555:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876607738368640:12345-0@lo:400: 00000100:00100000:3.0:1789672774.982581:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876607738368640:12345-0@lo:400: Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672774.982586:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789672774.982605:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789672774.982611:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738367488:12345-0@lo:400: 00000100:00100000:3.0:1789672774.982638:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738367488:12345-0@lo:400: Request processed in 28us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672774.982644:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789672774.982654:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789672774.982683:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876607738368000:12345-0@lo:400: 00000100:00100000:3.0:1789672774.982706:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876607738368000:12345-0@lo:400: Request processed in 48us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672774.982712:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789672774.982722:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789672774.982728:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876607738368512:12345-0@lo:400: 00000100:00100000:3.0:1789672774.982752:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876607738368512:12345-0@lo:400: Request processed in 24us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672774.982753:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738367232 00000100:00100000:3.0:1789672774.982758:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789672774.982758:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738367232 00000100:00100000:3.0:1789672774.982776:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789672774.982783:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738367616:12345-0@lo:400: 00000100:00100000:1.0:1789672774.982783:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789672774.982788:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738367232:12345-0@lo:13: 00002000:00000024:1.0:1789672774.982801:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672774.982810:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738367616:12345-0@lo:400: Request processed in 28us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672774.982815:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789672774.982841:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738367232:12345-0@lo:13: Request processed in 53us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672774.982846:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789672774.982859:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738367488:0@lo:400: 00000100:00100000:1.0:1789672774.982867:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738367360 00000100:00100000:3.0:1789672774.982870:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876607738368000:0@lo:400: 00000100:00100000:1.0:1789672774.982870:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738367360 00000100:00100000:3.0:1789672774.982878:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876607738368512:0@lo:400: 00000100:00100000:3.0:1789672774.982887:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738367616:0@lo:400: 00000100:00100000:1.0:1789672774.982895:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789672774.982900:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738367360:12345-0@lo:400: 00010000:00080000:3.0:1789672774.982909:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8ca680 x1876607738368128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672774.982919:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738368128:0@lo:400: 00010000:00080000:3.0:1789672774.982929:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8cb800 x1876607738368640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672774.982929:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738367360:12345-0@lo:400: Request processed in 28us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672774.982935:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789672774.982937:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876607738368640:0@lo:400: 00000100:00080000:1.0:1789672774.983061:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789672774.983066:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789672774.983068:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789672774.983071:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672774.984084:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738367360:0@lo:400: 00000100:00100000:3.0:1789672774.984101:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738367872:0@lo:400: 00010000:00080000:3.0:1789672774.984114:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8ca300 x1876607738368384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672774.984124:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738368384:0@lo:400: 00010000:00080000:3.0:1789672774.984135:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7dac1180 x1876607738367232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672774.984143:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789672774.984163:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738367232:0@lo:13: 00000100:00100000:3.0:1789672774.984176:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738367744:0@lo:400: 00010000:00080000:3.0:1789672774.984186:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8c9500 x1876607738368256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672774.984194:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738368256:0@lo:400: 00010000:00080000:3.0:1789672774.984202:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8c9880 x1876607738368768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672774.984208:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738368768:0@lo:400: 00000100:00100000:0.0:1789672774.985778:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738367872:12345-0@lo:400: Request processed in 47us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672774.985793:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:3.0:1789672775.877619:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672776.516010:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738368896:0@lo:13: 00000100:00100000:0.0:1789672776.516087:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672776.516230:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738368896 00000100:00100000:1.0:1789672776.516241:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738368896 00000100:00100000:1.0:1789672776.516317:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789672776.516329:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738368896:12345-0@lo:13: 00002000:00000024:1.0:1789672776.516370:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789672776.516638:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672776.517006:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672776.517021:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738369024:0@lo:13: 00000100:00100000:3.0:1789672776.517060:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672776.517095:0:8432:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1789672776.517103:0:8432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1789672776.517237:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738369024 00000100:00100000:3.0:1789672776.517243:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738369024 00000100:00100000:3.0:1789672776.517367:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789672776.517376:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738369024:12345-0@lo:13: 00002000:00000024:3.0:1789672776.517393:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672776.517444:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738369024:12345-0@lo:13: Request processed in 69us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672776.517451:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789672776.517491:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb4744dc00 x1876607738369024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672776.517511:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738369024:0@lo:13: 00000100:00080000:2.0:1789672776.522718:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672776.527705:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738368896:12345-0@lo:13: Request processed in 11368us (11607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672776.527721:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1789672776.529638:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8dd500 x1876607738368896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672776.529822:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738368896:0@lo:13: 00000100:00100000:1.0:1789672776.829422:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672776.829537:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714201088 00000100:00100000:3.0:1789672776.829548:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714201088 00000100:00100000:3.0:1789672776.829635:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:3.0:1789672776.829646:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:6249:x1876607714201088:12345-192.168.201.50@tcp:41: 00000004:00000024:3.0:1789672776.829717:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789672776.829790:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:6249:x1876607714201088:12345-192.168.201.50@tcp:41: Request processed in 145us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672776.829797:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00080000:0.0:1789672776.829918:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672776.834147:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672776.834358:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714201216 00000100:00100000:1.0:1789672776.834368:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714201216 00000100:00100000:1.0:1789672776.834455:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:1.0:1789672776.834468:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:6249:x1876607714201216:12345-192.168.201.50@tcp:41: 00000004:00000024:1.0:1789672776.834512:0:9524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789672776.834608:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:6249:x1876607714201216:12345-192.168.201.50@tcp:41: Request processed in 142us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672776.834616:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00080000:0.0:1789672776.834741:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789672776.848139:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672776.848585:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714201344 00000100:00100000:3.0:1789672776.848613:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714201344 00000100:00100000:3.0:1789672776.848726:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:3.0:1789672776.848738:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:6249:x1876607714201344:12345-192.168.201.50@tcp:13: 00002000:00000024:3.0:1789672776.848770:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672776.848845:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:6249:x1876607714201344:12345-192.168.201.50@tcp:13: Request processed in 109us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672776.848852:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00080000:0.0:1789672776.849346:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672776.851129:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672776.852457:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714201472 00000100:00100000:1.0:1789672776.852471:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714201472 00000100:00100000:0.0:1789672776.858079:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:0.0:1789672776.858097:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:6249:x1876607714201472:12345-192.168.201.50@tcp:13: 00002000:00000024:0.0:1789672776.858137:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672776.858230:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:6249:x1876607714201472:12345-192.168.201.50@tcp:13: Request processed in 138us (7109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672776.858238:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00080000:2.0:1789672776.861374:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789672776.901519:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672777.544179:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738369152:0@lo:41: 00000100:00100000:2.0:1789672777.544319:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672777.544699:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738369152 00000100:00100000:1.0:1789672777.544712:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738369152 00000100:00100000:1.0:1789672777.544787:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789672777.544799:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738369152:12345-0@lo:41: 00000004:00000024:1.0:1789672777.544847:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789672777.544930:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738369152:12345-0@lo:41: Request processed in 133us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672777.544937:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789672777.544992:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738369152:0@lo:41: 00010000:00010000:3.0:1789672777.925327:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789672778.060351:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000001:00100000:2.0:1789672778.060775:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000001:00100000:1.0:1789672778.060997:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000100:00100000:1.0:1789672778.567863:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672778.567901:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738369280:0@lo:41: 00000100:00100000:1.0:1789672778.567999:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672778.569044:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738369280 00000100:00100000:2.0:1789672778.569058:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738369280 00000100:00100000:2.0:1789672778.569132:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789672778.569145:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738369280:12345-0@lo:41: 00000004:00000024:2.0:1789672778.569198:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789672778.569301:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738369280:12345-0@lo:41: Request processed in 158us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672778.569308:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789672778.569423:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738369280:0@lo:41: 00010000:00010000:0.0:1789672778.947909:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789672779.083196:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000100:00100000:3.0:1789672779.217209:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672779.217273:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672779.217310:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672779.217335:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672779.217363:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672779.217411:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714202112 00000100:00100000:3.0:1789672779.217425:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714202112 00000100:00100000:3.0:1789672779.217509:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714201984 00000100:00100000:3.0:1789672779.217513:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714201984 00000100:00100000:3.0:1789672779.217544:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:3.0:1789672779.217556:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714202112:12345-192.168.201.50@tcp:400: 00000100:00100000:3.0:1789672779.217695:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714202112:12345-192.168.201.50@tcp:400: Request processed in 104us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672779.217703:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:3.0:1789672779.217744:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:3.0:1789672779.217750:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714201984:12345-192.168.201.50@tcp:400: 00000100:00100000:3.0:1789672779.217797:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714201984:12345-192.168.201.50@tcp:400: Request processed in 47us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672779.217804:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:1.0:1789672779.218049:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714201600 00000100:00100000:1.0:1789672779.218056:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714201600 00000100:00100000:1.0:1789672779.218093:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 199 00000100:00100000:1.0:1789672779.218101:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2398:x1876607714201600:12345-192.168.201.50@tcp:400: 00000100:00100000:1.0:1789672779.218140:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2398:x1876607714201600:12345-192.168.201.50@tcp:400: Request processed in 40us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672779.218147:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 199 00000100:00100000:1.0:1789672779.218183:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714201856 00000100:00100000:1.0:1789672779.218187:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714201856 00000100:00100000:1.0:1789672779.218239:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714201728 00000100:00100000:1.0:1789672779.218242:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714201728 00000100:00100000:1.0:1789672779.218269:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:1.0:1789672779.218277:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714201856:12345-192.168.201.50@tcp:400: 00000100:00100000:1.0:1789672779.218310:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714201856:12345-192.168.201.50@tcp:400: Request processed in 33us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672779.218316:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:1.0:1789672779.218329:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:1.0:1789672779.218335:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714201728:12345-192.168.201.50@tcp:400: 00000100:00100000:1.0:1789672779.218360:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714201728:12345-192.168.201.50@tcp:400: Request processed in 26us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672779.218366:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00080000:1.0:1789672779.218494:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789672779.218499:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789672779.218502:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672779.218504:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789672779.974504:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672780.102609:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738369408:0@lo:13: 00000100:00100000:2.0:1789672780.102746:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672780.103046:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738369408 00000100:00100000:3.0:1789672780.103056:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738369408 00000100:00100000:3.0:1789672780.103140:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789672780.103153:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738369408:12345-0@lo:13: 00002000:00000024:3.0:1789672780.103213:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672780.103275:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738369408:12345-0@lo:13: Request processed in 126us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672780.103284:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789672780.103356:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789672780.103394:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7dac0000 x1876607738369408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672780.103429:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738369408:0@lo:13: 00000100:00100000:1.0:1789672780.105417:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789672780.105451:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738369536:0@lo:13: 00000100:00100000:1.0:1789672780.105540:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672780.107569:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738369536 00000100:00100000:3.0:1789672780.107588:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738369536 00000100:00100000:3.0:1789672780.107705:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789672780.107718:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738369536:12345-0@lo:13: 00002000:00000024:3.0:1789672780.107752:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672780.107857:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738369536:12345-0@lo:13: Request processed in 141us (2317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672780.107865:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789672780.107922:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8c9880 x1876607738369536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672780.107949:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738369536:0@lo:13: 00000100:00080000:1.0:1789672780.108083:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672780.109698:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738369664:0@lo:400: 00000100:00100000:3.0:1789672780.109797:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672780.109928:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738369792:0@lo:400: 00000100:00100000:2.0:1789672780.109969:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672780.110038:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738369792 00000100:00100000:2.0:1789672780.110048:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738369792 00000100:00100000:2.0:1789672780.110107:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789672780.110130:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738369792:12345-0@lo:400: 00000100:00100000:2.0:1789672780.110192:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738369792:12345-0@lo:400: Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672780.110211:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789672780.111588:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738369792:0@lo:400: 00000100:00100000:2.0:1789672780.111687:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789672780.111699:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738369920:0@lo:400: 00000100:00100000:2.0:1789672780.111760:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672780.111798:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738369920 00000100:00100000:2.0:1789672780.111805:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738369920 00000100:00100000:2.0:1789672780.111856:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789672780.111865:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738369920:12345-0@lo:400: 00000100:00100000:2.0:1789672780.111931:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738369920:12345-0@lo:400: Request processed in 66us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672780.111939:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789672780.111975:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738369920:0@lo:400: 00000100:00100000:2.0:1789672780.112010:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738370048:0@lo:400: 00000100:00100000:2.0:1789672780.112038:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672780.112089:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738370048 00000100:00100000:2.0:1789672780.112093:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738370048 00000100:00100000:2.0:1789672780.112125:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789672780.112131:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738370048:12345-0@lo:400: 00000100:00100000:2.0:1789672780.112169:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738370048:12345-0@lo:400: Request processed in 38us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672780.112175:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789672780.112217:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738370048:0@lo:400: 00000100:00100000:2.0:1789672780.112244:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672780.112251:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738370176:0@lo:400: 00000100:00100000:2.0:1789672780.112276:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672780.112305:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738370176 00000100:00100000:2.0:1789672780.112309:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738370176 00000100:00100000:2.0:1789672780.112333:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789672780.112339:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738370176:12345-0@lo:400: 00000100:00100000:3.0:1789672780.112620:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672780.112630:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738370304:0@lo:400: 00000100:00100000:3.0:1789672780.112682:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672780.112728:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738370432:0@lo:400: 00000100:00100000:3.0:1789672780.112751:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672780.112793:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672780.112800:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738370560:0@lo:400: 00000100:00100000:3.0:1789672780.112831:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672780.112862:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738370560 00000100:00100000:3.0:1789672780.112865:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738370560 00000100:00100000:3.0:1789672780.112915:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789672780.112923:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738370560:12345-0@lo:400: 00000100:00100000:3.0:1789672780.112964:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738370560:12345-0@lo:400: Request processed in 43us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672780.112970:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789672780.112995:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789672780.113018:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462dca80 x1876607738370560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672780.113030:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738370560:0@lo:400: 00000100:00100000:3.0:1789672780.113060:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738370688:0@lo:400: 00000100:00100000:3.0:1789672780.113082:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672780.113111:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738370688 00000100:00100000:3.0:1789672780.113115:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738370688 00000100:00100000:3.0:1789672780.113148:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789672780.113154:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738370688:12345-0@lo:400: 00000100:00100000:3.0:1789672780.113214:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738370688:12345-0@lo:400: Request processed in 47us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672780.113221:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789672780.113240:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789672780.113256:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462dca80 x1876607738370688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672780.113266:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738370688:0@lo:400: 00000100:00100000:3.0:1789672780.113292:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672780.113299:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738370816:0@lo:400: 00000100:00100000:3.0:1789672780.113322:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672780.113459:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876607738370944:0@lo:400: 00000100:00100000:3.0:1789672780.113485:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672780.114528:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738370176:12345-0@lo:400: Request processed in 2186us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672780.114538:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789672780.114578:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738370304 00000100:00100000:2.0:1789672780.114586:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738370304 00000100:00100000:2.0:1789672780.114622:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738370432 00000100:00100000:2.0:1789672780.114625:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738370432 00000100:00100000:2.0:1789672780.114637:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738370816 00000100:00100000:2.0:1789672780.114639:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738370816 00000100:00100000:2.0:1789672780.114651:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738370944 00000100:00100000:2.0:1789672780.114654:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738370944 00000100:00100000:2.0:1789672780.114692:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789672780.114700:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738370304:12345-0@lo:400: 00000100:00100000:2.0:1789672780.114742:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738370304:12345-0@lo:400: Request processed in 43us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672780.114757:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789672780.114770:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789672780.114775:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738370432:12345-0@lo:400: 00000100:00100000:2.0:1789672780.114801:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738370432:12345-0@lo:400: Request processed in 25us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672780.114806:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789672780.114816:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789672780.114822:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738370816:12345-0@lo:400: 00000100:00100000:2.0:1789672780.114849:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738370816:12345-0@lo:400: Request processed in 27us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672780.114855:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789672780.114866:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789672780.114872:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876607738370944:12345-0@lo:400: 00000100:00100000:2.0:1789672780.114899:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876607738370944:12345-0@lo:400: Request processed in 27us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672780.114905:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789672780.114950:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738370176:0@lo:400: 00010000:00080000:2.0:1789672780.114998:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47905c00 x1876607738370944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672780.115009:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876607738370944:0@lo:400: 00000100:00100000:2.0:1789672780.115018:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738370816:0@lo:400: 00010000:00080000:2.0:1789672780.115030:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462dd180 x1876607738370432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672780.115038:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738370432:0@lo:400: 00000100:00100000:2.0:1789672780.115058:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738370304:0@lo:400: 00000100:00080000:3.0:1789672780.115189:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789672780.115194:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672780.115281:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738369664 00000100:00100000:1.0:1789672780.115289:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738369664 00000100:00100000:1.0:1789672780.115334:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789672780.115420:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3636:x1876607738369664:12345-0@lo:400: 00000100:00100000:1.0:1789672780.115470:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3636:x1876607738369664:12345-0@lo:400: Request processed in 129us (5673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672780.115478:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789672780.115584:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738369664:0@lo:400: 00000001:02000400:0.0:1789672780.116298:0:10179:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789672780.995890:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672781.647781:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738371072:0@lo:13: 00000100:00100000:3.0:1789672781.647906:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672781.651871:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672781.651893:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738371200:0@lo:13: 00000100:00100000:3.0:1789672781.652297:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672781.652359:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738371072 00000100:00100000:3.0:1789672781.652371:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738371072 00000100:00100000:3.0:1789672781.652431:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738371200 00000100:00100000:3.0:1789672781.652435:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738371200 00000100:00100000:3.0:1789672781.652454:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789672781.652465:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738371072:12345-0@lo:13: 00002000:00000024:3.0:1789672781.652516:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672781.652579:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738371072:12345-0@lo:13: Request processed in 115us (4673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672781.652588:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789672781.652608:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789672781.652615:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738371200:12345-0@lo:13: 00002000:00000024:3.0:1789672781.652625:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672781.652650:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738371200:12345-0@lo:13: Request processed in 36us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672781.652656:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789672781.656155:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d9f0000 x1876607738371200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672781.656207:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738371200:0@lo:13: 00010000:00080000:3.0:1789672781.656226:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47906a00 x1876607738371072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672781.656240:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738371072:0@lo:13: 00010000:00010000:3.0:1789672782.025031:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672782.660963:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672782.661003:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738371328:0@lo:41: 00000100:00100000:3.0:1789672782.661097:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672782.661452:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738371328 00000100:00100000:0.0:1789672782.661482:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738371328 00000100:00100000:0.0:1789672782.661569:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789672782.661582:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738371328:12345-0@lo:41: 00000004:00000024:0.0:1789672782.661632:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789672782.661902:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738371328:12345-0@lo:41: Request processed in 322us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672782.661910:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789672782.662055:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738371328:0@lo:41: 00010000:00010000:3.0:1789672783.045106:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672783.684161:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672783.684191:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738371456:0@lo:41: 00000100:00100000:0.0:1789672783.684403:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672783.684616:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738371456 00000100:00100000:3.0:1789672783.684628:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738371456 00000100:00100000:3.0:1789672783.686094:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789672783.686115:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738371456:12345-0@lo:41: 00000004:00000024:3.0:1789672783.686189:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789672783.686774:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738371456:12345-0@lo:41: Request processed in 665us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672783.686783:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789672783.688913:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738371456:0@lo:41: 00000020:00000080:1.0:1789672783.791080:0:10327:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd31bbc0c0 20000000:00000080:1.0:1789672783.791100:0:10327:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cfc7f583800 uarg=0000000000000000 20000000:01000000:1.0:1789672783.791173:0:10327:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789672783.791176:0:10327:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789672783.791178:0:10327:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789672783.791184:0:10327:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789672783.791190:0:10327:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789672783.791254:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789672783.791257:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789672783.794012:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1789672783.796946:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1789672783.796987:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1789672783.797001:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1789672783.797013:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789672783.797017:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789672783.797553:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1789672783.798682:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1789672783.798715:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1789672783.798730:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1789672783.798742:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789672783.798745:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789672783.799732:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1789672783.800067:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1789672783.800092:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1789672783.800106:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1789672783.800117:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789672783.800119:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789672783.803289:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1789672783.803642:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1789672783.803725:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1789672783.803740:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1789672783.803751:0:10327:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789672783.803754:0:10327:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789672783.805701:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1789672783.806162:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1789672783.806188:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1789672783.806197:0:10327:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:1.0:1789672783.806207:0:10327:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789672783.806225:0:10327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c996503a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806242:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9964ed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964ece expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806261:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc61609e00/0x6c78c4f8c9964eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964ef8 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806275:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964f3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f37 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806283:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc61609800/0x6c78c4f8c9964f4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f45 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806290:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc52434a00/0x6c78c4f8c9964f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f53 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806296:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc52434600/0x6c78c4f8c9964f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f6f expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806302:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d887e00/0x6c78c4f8c9964fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964f99 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806309:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c9964fbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964fb5 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806316:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc61608800/0x6c78c4f8c9964fe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964fdf expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806326:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d8a0c00/0x6c78c4f8c9964ff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e8a expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806333:0:10327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d887800/0x6c78c4f8c9964ffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e91 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806340:0:10327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c996503a lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806401:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d887800/0x6c78c4f8c9964ffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e91 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806414:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfc7d887800/0x6c78c4f8c9964ffb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e91 expref: 9 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672783.806426:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738371584:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672783.806535:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d8a0c00/0x6c78c4f8c9964ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e8a expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806541:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfc7d8a0c00/0x6c78c4f8c9964ff4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e8a expref: 9 pid: 6506 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672783.806547:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738371712:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672783.806567:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc61608800/0x6c78c4f8c9964fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964fdf expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806572:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc61608800/0x6c78c4f8c9964fe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964fdf expref: 23 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672783.806578:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738371840:0@lo:104: 00000100:00100000:1.0:1789672783.806831:0:10327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672783.806863:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c9964fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964fb5 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806869:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c9964fbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964fb5 expref: 23 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672783.806883:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738371968:0@lo:104: 00000100:00100000:1.0:1789672783.806900:0:10327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672783.806916:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d887e00/0x6c78c4f8c9964fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964f99 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.806921:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc7d887e00/0x6c78c4f8c9964fa0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f99 expref: 23 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672783.806927:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738372096:0@lo:104: 00000100:00100000:1.0:1789672783.806939:0:10327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672783.809807:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738371840 00000100:00100000:0.0:1789672783.809824:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738371840 00000100:00100000:0.0:1789672783.809883:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738371968 00000100:00100000:0.0:1789672783.809886:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738371968 00000100:00100000:0.0:1789672783.809902:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789672783.809911:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:10327:x1876607738371840:12345-0@lo:104: 00010000:00010000:0.0:1789672783.809929:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9964fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964fe6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.810095:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789672783.810102:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:10327:x1876607738371840:12345-0@lo:104: Request processed in 192us (3270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672783.810108:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789672783.810127:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789672783.810134:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:10327:x1876607738371968:12345-0@lo:104: 00010000:00010000:0.0:1789672783.810154:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc52435400/0x6c78c4f8c9964fb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964fbc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672783.810356:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789672783.810364:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9964fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964fe6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672783.810373:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886400 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:3.0:1789672783.810378:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9964fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964fe6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672783.810388:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9964fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964fe6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672783.810396:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9964fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964fe6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672783.810402:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789672783.810455:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9964fdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964fe6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672783.810462:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789672783.810483:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9964fdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964fe6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672783.810490:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9964fdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964fe6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672783.810506:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672783.810515:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc52435400/0x6c78c4f8c9964fb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964fbc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672783.810521:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435400 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:3.0:1789672783.810525:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52435400/0x6c78c4f8c9964fb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964fbc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672783.810532:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc52435400/0x6c78c4f8c9964fb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964fbc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672783.810539:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52435400/0x6c78c4f8c9964fb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964fbc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672783.810545:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789672783.810559:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc52435400/0x6c78c4f8c9964fb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964fbc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672783.810565:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789672783.810570:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc52435400/0x6c78c4f8c9964fb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964fbc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672783.810577:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc52435400/0x6c78c4f8c9964fb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964fbc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672783.810587:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672783.810589:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672783.810591:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672783.810617:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738372224:0@lo:103: 00010000:00010000:1.0:1789672783.810748:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc52434600/0x6c78c4f8c9964f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964f6f expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.810761:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc52434600/0x6c78c4f8c9964f76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f6f expref: 23 pid: 6506 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672783.810770:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738372480:0@lo:104: 00000100:00100000:1.0:1789672783.810803:0:10327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789672783.810807:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1789672783.810815:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:10327:x1876607738371968:12345-0@lo:104: Request processed in 681us (3912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672783.810823:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1789672783.810834:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc52434a00/0x6c78c4f8c9964f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964f53 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.810844:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc52434a00/0x6c78c4f8c9964f5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f53 expref: 23 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672783.810848:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789672783.810855:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738372608:0@lo:104: 00000100:00100000:0.0:1789672783.810860:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738372096 00000100:00100000:0.0:1789672783.810866:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738372096 00000100:00100000:1.0:1789672783.810883:0:10327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672783.810886:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738372480 00000100:00100000:0.0:1789672783.810890:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738372480 00000100:00100000:0.0:1789672783.810904:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738372608 00010000:00010000:1.0:1789672783.810906:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc61609800/0x6c78c4f8c9964f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964f45 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672783.810908:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738372608 00000100:00100000:0.0:1789672783.810923:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789672783.810932:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:10327:x1876607738372096:12345-0@lo:104: 00010000:00010000:1.0:1789672783.810934:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc61609800/0x6c78c4f8c9964f4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f45 expref: 23 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.810943:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc61608a00/0x6c78c4f8c9964f99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964fa0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672783.810948:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47938700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738372736:0@lo:104: 00000100:00100000:1.0:1789672783.810990:0:10327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789672783.811000:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789672783.811006:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:10327:x1876607738372096:12345-0@lo:104: Request processed in 76us (4065us total) trans 0 rc 0/0 00010000:00010000:1.0:1789672783.811014:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964f37 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672783.811015:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789672783.811027:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964f3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f37 expref: 23 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672783.811028:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738372736 00000100:00100000:0.0:1789672783.811033:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738372736 00000100:00100000:1.0:1789672783.811042:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738372864:0@lo:104: 00000100:00100000:0.0:1789672783.811050:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789672783.811057:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc58b77850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:10327:x1876607738372480:12345-0@lo:104: 00010000:00010000:0.0:1789672783.811065:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c9964f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964f76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672783.811067:0:10327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672783.811091:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc61609e00/0x6c78c4f8c9964eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964ef8 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.811100:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc61609e00/0x6c78c4f8c9964eff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964ef8 expref: 23 pid: 6506 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.811102:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789672783.811110:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738372992:0@lo:104: 00000100:00100000:0.0:1789672783.811117:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc58b77850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:10327:x1876607738372480:12345-0@lo:104: Request processed in 58us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672783.811126:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789672783.811149:0:10327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672783.811173:0:10327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9964ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964ece expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.811181:0:10327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9964ed5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964ece expref: 23 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672783.811184:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738372864 00000100:00100000:0.0:1789672783.811190:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738372864 00000100:00100000:1.0:1789672783.811194:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738373120:0@lo:104: 00000100:00100000:0.0:1789672783.811203:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738372992 00000100:00100000:1.0:1789672783.811223:0:10327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672783.811235:0:10327:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43a50e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789672783.811256:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738371840:0@lo:104: 00000100:00100000:1.0:1789672783.811265:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738371968:0@lo:104: 00000100:00100000:1.0:1789672783.811272:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738372096:0@lo:104: 00000100:00100000:1.0:1789672783.811280:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738372480:0@lo:104: 00000100:00100000:3.0:1789672783.811327:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672783.811496:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738373120 00000100:00100000:2.0:1789672783.811501:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738373120 00000100:00100000:2.0:1789672783.811526:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789672783.811534:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+6:10327:x1876607738372608:12345-0@lo:104: 00010000:00010000:2.0:1789672783.811544:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9964f53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964f5a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672783.811595:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789672783.811600:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+6:10327:x1876607738372608:12345-0@lo:104: Request processed in 68us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672783.811606:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789672783.811619:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789672783.811625:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47939f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:10327:x1876607738372736:12345-0@lo:104: 00010000:00010000:2.0:1789672783.811632:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c9964f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964f4c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672783.811689:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789672783.811694:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47939f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:10327:x1876607738372736:12345-0@lo:104: Request processed in 70us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672783.811700:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789672783.811713:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789672783.811718:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:10327:x1876607738372864:12345-0@lo:104: 00010000:00010000:2.0:1789672783.811726:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9964f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964f3e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672783.811752:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789672783.811757:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:10327:x1876607738372864:12345-0@lo:104: Request processed in 39us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672783.811762:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789672783.811772:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789672783.811777:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:10327:x1876607738373120:12345-0@lo:104: 00010000:00010000:2.0:1789672783.811784:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c9964ece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964ed5 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672783.811806:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789672783.811811:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:10327:x1876607738373120:12345-0@lo:104: Request processed in 35us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672783.811816:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789672783.811861:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738372608:0@lo:104: 00000100:00100000:2.0:1789672783.811868:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47938700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738372736:0@lo:104: 00000100:00100000:2.0:1789672783.811874:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738372864:0@lo:104: 00000100:00100000:2.0:1789672783.811891:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738373120:0@lo:104: 00000100:00100000:3.0:1789672783.812119:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672783.812128:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738372352:0@lo:103: 00000100:00100000:3.0:1789672783.812176:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672783.812230:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738372992 00000100:00100000:0.0:1789672783.812268:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789672783.812275:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:10327:x1876607738372992:12345-0@lo:104: 00010000:00010000:0.0:1789672783.812284:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964ef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964eff expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812318:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1789672783.812323:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:10327:x1876607738372992:12345-0@lo:104: Request processed in 50us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672783.812329:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1789672783.812344:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789672783.812350:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc61608a00/0x6c78c4f8c9964f99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964fa0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812356:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61608a00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789672783.812360:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61608a00/0x6c78c4f8c9964f99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964fa0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812368:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc61608a00/0x6c78c4f8c9964f99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964fa0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672783.812375:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61608a00/0x6c78c4f8c9964f99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964fa0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672783.812391:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789672783.812418:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc61608a00/0x6c78c4f8c9964f99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964fa0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812424:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672783.812442:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc61608a00/0x6c78c4f8c9964f99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964fa0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812449:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc61608a00/0x6c78c4f8c9964f99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964fa0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812461:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789672783.812464:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c9964f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964f76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812469:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887600 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789672783.812472:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c9964f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964f76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812478:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c9964f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964f76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672783.812483:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c9964f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964f76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672783.812488:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789672783.812499:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c9964f6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964f76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812505:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672783.812516:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c9964f6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964f76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812522:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c9964f6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964f76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812531:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789672783.812534:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9964f53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964f5a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812539:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0400 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789672783.812541:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9964f53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964f5a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812547:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9964f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964f5a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672783.812552:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9964f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964f5a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672783.812557:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789672783.812570:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9964f53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964f5a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812575:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672783.812580:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9964f53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964f5a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812586:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9964f53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964f5a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812594:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789672783.812603:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c9964f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964f4c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812608:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434e00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789672783.812610:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c9964f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964f4c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812616:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c9964f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964f4c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672783.812622:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c9964f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964f4c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672783.812627:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789672783.812638:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c9964f45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964f4c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812655:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672783.812680:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c9964f45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964f4c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812686:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c9964f45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964f4c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812694:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789672783.812697:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9964f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964f3e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812702:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a1e00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789672783.812705:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9964f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964f3e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812720:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9964f37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964f3e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672783.812726:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9964f37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964f3e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672783.812730:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789672783.812743:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9964f37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964f3e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812749:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672783.812753:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9964f37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964f3e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812759:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9964f37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964f3e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812767:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789672783.812770:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c9964ece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964ed5 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812776:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887200 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789672783.812778:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c9964ece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964ed5 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812785:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c9964ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964ed5 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672783.812791:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c9964ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964ed5 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672783.812803:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789672783.812817:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c9964ece lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964ed5 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812824:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672783.812829:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c9964ece lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964ed5 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812835:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c9964ece lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964ed5 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812844:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672783.812847:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964ef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964eff expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812853:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61608e00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789672783.812856:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964ef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964eff expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812862:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964eff expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672783.812868:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964eff expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672783.812873:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789672783.812885:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964ef8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964eff expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812890:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672783.812901:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964ef8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964eff expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812908:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c9964ef8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964eff expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.812922:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672783.812924:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672783.812926:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672783.812968:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738373248:0@lo:103: 00000100:00100000:0.0:1789672783.813007:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738373376:0@lo:103: 00010000:00010000:0.0:1789672783.813030:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672783.814192:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738371584:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789672783.814212:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738372992:0@lo:104: 00000100:00100000:2.0:1789672783.815039:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738373632:0@lo:103: 00000100:00100000:3.0:1789672783.820055:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738373504:0@lo:103: 00000100:00100000:3.0:1789672783.820133:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672783.822214:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738372224 00000100:00100000:1.0:1789672783.822231:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738372224 00010000:00010000:1.0:1789672783.822474:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc61608800/0x6c78c4f8c9964fe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964fdf expref: 24 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672783.823768:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738372352 00000100:00100000:0.0:1789672783.823783:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738372352 00010000:00010000:0.0:1789672783.823844:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c9964fbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964fb5 expref: 25 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672783.823928:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789672783.823942:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc65c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+25:3635:x1876607738372224:12345-0@lo:103: 00010000:00010000:0.0:1789672783.823961:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672783.823970:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc61608800/0x6c78c4f8c9964fe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964fdf expref: 25 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.823983:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc61608800/0x6c78c4f8c9964fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964fdf expref: 25 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.824002:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc61608800/0x6c78c4f8c9964fe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964fdf expref: 25 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.824021:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672783.824129:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc65c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3635:x1876607738372224:12345-0@lo:103: Request processed in 189us (12801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672783.824146:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789672783.824210:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789672783.824217:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:3635:x1876607738372352:12345-0@lo:103: 00010000:00010000:0.0:1789672783.824224:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672783.824228:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c9964fbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964fb5 expref: 23 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.824237:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c9964fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964fb5 expref: 23 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.824248:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c9964fbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964fb5 expref: 23 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.824256:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672783.824279:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:3635:x1876607738372352:12345-0@lo:103: Request processed in 63us (12103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672783.824285:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789672783.824477:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738374016:0@lo:103: 00000100:00100000:3.0:1789672783.824523:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672783.824550:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738372352:0@lo:103: 00000100:00100000:3.0:1789672783.824561:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738372224:0@lo:103: 00000100:00100000:3.0:1789672783.824847:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672783.824868:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738373760:0@lo:103: 00000100:00100000:3.0:1789672783.824894:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672783.824919:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672783.824949:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672783.825035:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672783.825179:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738373504 00000100:00100000:0.0:1789672783.825186:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738373504 00010000:00010000:0.0:1789672783.825211:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc52434a00/0x6c78c4f8c9964f5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f53 expref: 22 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672783.825229:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738374016 00000100:00100000:0.0:1789672783.825233:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738374016 00010000:00010000:0.0:1789672783.825244:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc61609e00/0x6c78c4f8c9964eff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964ef8 expref: 23 pid: 6506 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672783.825254:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738373248 00000100:00100000:0.0:1789672783.825256:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738373248 00010000:00010000:0.0:1789672783.825274:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d887e00/0x6c78c4f8c9964fa0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f99 expref: 24 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672783.825284:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738373760 00000100:00100000:0.0:1789672783.825286:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738373760 00010000:00010000:0.0:1789672783.825293:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964f3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f37 expref: 25 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672783.825302:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738373632 00000100:00100000:0.0:1789672783.825304:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738373632 00010000:00010000:0.0:1789672783.825312:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc61609800/0x6c78c4f8c9964f4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f45 expref: 26 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672783.825319:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714202240 00000100:00100000:0.0:1789672783.825322:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714202240 00010000:00010000:0.0:1789672783.825334:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d887800/0x6c78c4f8c9964ffb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e91 expref: 10 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672783.825343:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714202368 00000100:00100000:0.0:1789672783.825344:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714202368 00010000:00010000:0.0:1789672783.825352:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d8a0c00/0x6c78c4f8c9964ff4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e8a expref: 11 pid: 6506 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672783.825363:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789672783.825369:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47906d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+26:3635:x1876607738373504:12345-0@lo:103: 00010000:00010000:0.0:1789672783.825380:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672783.825385:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc52434a00/0x6c78c4f8c9964f5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f53 expref: 26 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.825395:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc52434a00/0x6c78c4f8c9964f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f53 expref: 26 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.825417:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc52434a00/0x6c78c4f8c9964f5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964f53 expref: 26 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.825429:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672783.825470:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47906d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+25:3635:x1876607738373504:12345-0@lo:103: Request processed in 100us (5336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672783.825476:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789672783.825500:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789672783.825506:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3635:x1876607738374016:12345-0@lo:103: 00010000:00010000:0.0:1789672783.825515:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672783.825519:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc61609e00/0x6c78c4f8c9964eff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964ef8 expref: 24 pid: 6506 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.825528:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc61609e00/0x6c78c4f8c9964eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964ef8 expref: 24 pid: 6506 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.825538:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc61609e00/0x6c78c4f8c9964eff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964ef8 expref: 24 pid: 6506 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.825547:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672783.825569:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:3635:x1876607738374016:12345-0@lo:103: Request processed in 63us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672783.825576:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789672783.825587:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789672783.825593:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:3637:x1876607738373248:12345-0@lo:103: 00010000:00010000:0.0:1789672783.825600:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672783.825604:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d887e00/0x6c78c4f8c9964fa0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f99 expref: 22 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.825617:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d887e00/0x6c78c4f8c9964fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f99 expref: 22 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.825627:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d887e00/0x6c78c4f8c9964fa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964f99 expref: 22 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.825635:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672783.825755:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738373504:0@lo:103: 00000100:00100000:3.0:1789672783.825763:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738374016:0@lo:103: 00000100:00100000:0.0:1789672783.825963:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3637:x1876607738373248:12345-0@lo:103: Request processed in 369us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672783.825970:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789672783.825984:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789672783.825991:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:3637:x1876607738373760:12345-0@lo:103: 00010000:00010000:0.0:1789672783.825998:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672783.826003:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964f3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f37 expref: 20 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.826011:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f37 expref: 20 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.826020:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc52435600/0x6c78c4f8c9964f3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964f37 expref: 20 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.826028:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672783.826046:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:3637:x1876607738373760:12345-0@lo:103: Request processed in 57us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672783.826172:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789672783.826185:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789672783.826192:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:3636:x1876607738373632:12345-0@lo:103: 00010000:00010000:0.0:1789672783.826205:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672783.826209:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc61609800/0x6c78c4f8c9964f4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f45 expref: 18 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.826218:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc61609800/0x6c78c4f8c9964f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f45 expref: 18 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.826228:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc61609800/0x6c78c4f8c9964f4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964f45 expref: 18 pid: 6507 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.826237:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672783.826261:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:3636:x1876607738373632:12345-0@lo:103: Request processed in 70us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672783.826266:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789672783.826279:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:0.0:1789672783.826285:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:2395:x1876607714202240:12345-192.168.201.50@tcp:103: 00010000:00010000:0.0:1789672783.826293:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672783.826297:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d887800/0x6c78c4f8c9964ffb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e91 expref: 11 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.826308:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d887800/0x6c78c4f8c9964ffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e91 expref: 11 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.826318:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d887800/0x6c78c4f8c9964ffb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e91 expref: 11 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.826326:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672783.826365:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2395:x1876607714202240:12345-192.168.201.50@tcp:103: Request processed in 80us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672783.826380:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:0.0:1789672783.826394:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:0.0:1789672783.826399:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:2396:x1876607714202368:12345-192.168.201.50@tcp:103: 00010000:00010000:0.0:1789672783.826407:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672783.826411:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d8a0c00/0x6c78c4f8c9964ff4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e8a expref: 9 pid: 6506 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.826421:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d8a0c00/0x6c78c4f8c9964ff4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e8a expref: 9 pid: 6506 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.826430:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672783.826444:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:2396:x1876607714202368:12345-192.168.201.50@tcp:103: Request processed in 45us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672783.826450:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:3.0:1789672783.827422:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738373248:0@lo:103: 00000100:00100000:3.0:1789672783.827435:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738373760:0@lo:103: 00000100:00100000:3.0:1789672783.827467:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738373632:0@lo:103: 00010000:00010000:3.0:1789672783.827837:0:10327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8a0c00/0x6c78c4f8c9964ff4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24e8a expref: 8 pid: 6506 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672783.827857:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10327:1876607738371712:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789672783.827920:0:10327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c996503a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672783.828362:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672783.828437:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738373888:0@lo:103: 00000100:00100000:0.0:1789672783.828493:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672783.828697:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738373376 00000100:00100000:1.0:1789672783.828704:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738373888 00000100:00100000:2.0:1789672783.828706:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738373376 00000100:00100000:1.0:1789672783.828712:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738373888 00010000:00010000:2.0:1789672783.828748:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc52434600/0x6c78c4f8c9964f76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f6f expref: 18 pid: 6506 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672783.828748:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9964ed5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964ece expref: 18 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672783.828984:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789672783.828996:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc65c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:3638:x1876607738373376:12345-0@lo:103: 00010000:00010000:0.0:1789672783.829011:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672783.829019:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc52434600/0x6c78c4f8c9964f76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f6f expref: 18 pid: 6506 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.829034:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc52434600/0x6c78c4f8c9964f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964f6f expref: 18 pid: 6506 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.829065:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc52434600/0x6c78c4f8c9964f76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964f6f expref: 18 pid: 6506 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.829088:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672783.829133:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc65c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:3638:x1876607738373376:12345-0@lo:103: Request processed in 140us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672783.829152:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789672783.829223:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789672783.829231:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:3638:x1876607738373888:12345-0@lo:103: 00010000:00010000:0.0:1789672783.829239:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672783.829243:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9964ed5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964ece expref: 16 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.829252:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9964ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964ece expref: 16 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.829261:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9964ed5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964ece expref: 16 pid: 6504 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.829272:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c996503a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.829281:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c996503a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.829294:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c996503a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.829301:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c996503a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.829308:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c996503a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.829321:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c996503a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.829328:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61609c00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789672783.829332:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c996503a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.829341:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c996503a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.829352:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c996503a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672783.829360:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672783.829387:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:3638:x1876607738373888:12345-0@lo:103: Request processed in 157us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672783.829393:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789672783.829516:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738373376:0@lo:103: 00000100:00100000:3.0:1789672783.829525:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738373888:0@lo:103: 00010000:00010000:3.0:1789672783.829557:0:10327:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c996503a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672783.829565:0:10327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c996503a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672783.829572:0:10327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c996503a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672784.068068:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672784.339726:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672784.339912:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714202624 00000100:00100000:2.0:1789672784.339922:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714202624 00000100:00100000:2.0:1789672784.340003:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:2.0:1789672784.340014:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714202624:12345-192.168.201.50@tcp:400: 00000100:00100000:2.0:1789672784.340096:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714202624:12345-192.168.201.50@tcp:400: Request processed in 83us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672784.340104:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00080000:3.0:1789672784.340285:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789672784.347074:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672784.347382:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714202880 00000100:00100000:3.0:1789672784.347393:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714202880 00000100:00100000:3.0:1789672784.347471:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:3.0:1789672784.347561:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714202880:12345-192.168.201.50@tcp:400: 00000100:00100000:3.0:1789672784.347638:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714202880:12345-192.168.201.50@tcp:400: Request processed in 82us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672784.347646:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:0.0:1789672784.348377:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672784.348435:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00080000:2.0:1789672784.349256:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672784.350430:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714202496 00000100:00100000:3.0:1789672784.350441:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714202496 00000100:00100000:3.0:1789672784.350529:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:3.0:1789672784.350541:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714202496:12345-192.168.201.50@tcp:400: 00000100:00100000:3.0:1789672784.350621:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714202496:12345-192.168.201.50@tcp:400: Request processed in 83us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672784.350647:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:3.0:1789672784.350706:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714202752 00000100:00100000:3.0:1789672784.350710:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714202752 00000100:00100000:3.0:1789672784.350740:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:3.0:1789672784.350747:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714202752:12345-192.168.201.50@tcp:400: 00000100:00100000:3.0:1789672784.350776:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714202752:12345-192.168.201.50@tcp:400: Request processed in 29us (2341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672784.350782:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00080000:1.0:1789672784.351532:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672784.351539:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789672785.095283:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672785.220163:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672785.220196:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738374144:0@lo:13: 00000100:00100000:3.0:1789672785.220272:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672785.220357:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738374144 00000100:00100000:3.0:1789672785.220366:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738374144 00000100:00100000:3.0:1789672785.220421:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789672785.220430:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738374144:12345-0@lo:13: 00002000:00000024:3.0:1789672785.220472:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672785.220521:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738374144:12345-0@lo:13: Request processed in 92us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.220529:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789672785.220573:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47906300 x1876607738374144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672785.220590:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738374144:0@lo:13: 00000100:00080000:1.0:1789672785.220814:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789672785.220863:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789672785.220876:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738374272:0@lo:13: 00000100:00100000:0.0:1789672785.220911:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.220998:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738374272 00000100:00100000:1.0:1789672785.221005:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738374272 00000100:00100000:1.0:1789672785.221048:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789672785.221055:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738374272:12345-0@lo:13: 00002000:00000024:1.0:1789672785.221066:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672785.221103:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738374272:12345-0@lo:13: Request processed in 49us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672785.221120:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789672785.221148:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47938a80 x1876607738374272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672785.221184:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738374272:0@lo:13: 00000100:00080000:0.0:1789672785.221243:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789672785.221411:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738374656:0@lo:400: 00000100:00100000:2.0:1789672785.221443:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.221476:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738375168:0@lo:400: 00000100:00100000:2.0:1789672785.221499:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.221515:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876607738375680:0@lo:400: 00000100:00100000:2.0:1789672785.221533:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.221549:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789672785.221554:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738374528:0@lo:400: 00000100:00100000:2.0:1789672785.221572:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.221594:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876607738375040:0@lo:400: 00000100:00100000:2.0:1789672785.221616:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.221630:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876607738375552:0@lo:400: 00000100:00100000:2.0:1789672785.221648:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.221693:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738375168 00000100:00100000:2.0:1789672785.221698:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738375168 00000100:00100000:2.0:1789672785.221725:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738375680 00000100:00100000:2.0:1789672785.221729:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738375680 00000100:00100000:2.0:1789672785.221742:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738374528 00000100:00100000:2.0:1789672785.221744:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738374528 00000100:00100000:2.0:1789672785.221755:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738375040 00000100:00100000:2.0:1789672785.221757:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738375040 00000100:00100000:2.0:1789672785.221768:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738375552 00000100:00100000:2.0:1789672785.221770:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738375552 00000100:00100000:2.0:1789672785.221785:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789672785.221791:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738375168:12345-0@lo:400: 00000100:00100000:2.0:1789672785.221830:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738375168:12345-0@lo:400: Request processed in 39us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672785.221836:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789672785.221865:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789672785.221871:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876607738375680:12345-0@lo:400: 00000100:00100000:2.0:1789672785.221899:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876607738375680:12345-0@lo:400: Request processed in 28us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672785.221905:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789672785.221918:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789672785.221924:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738374528:12345-0@lo:400: 00000100:00100000:2.0:1789672785.221951:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738374528:12345-0@lo:400: Request processed in 27us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672785.221968:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789672785.221984:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789672785.221989:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876607738375040:12345-0@lo:400: 00000100:00100000:2.0:1789672785.222017:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876607738375040:12345-0@lo:400: Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672785.222022:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789672785.222043:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789672785.222050:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876607738375552:12345-0@lo:400: 00000100:00100000:2.0:1789672785.222074:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876607738375552:12345-0@lo:400: Request processed in 25us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672785.222080:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789672785.222120:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738374528:0@lo:400: 00000100:00100000:2.0:1789672785.222132:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876607738375040:0@lo:400: 00000100:00100000:2.0:1789672785.222140:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876607738375552:0@lo:400: 00010000:00080000:2.0:1789672785.222151:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462dea00 x1876607738375168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672785.222160:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738375168:0@lo:400: 00010000:00080000:2.0:1789672785.222170:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d96ea00 x1876607738375680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672785.222179:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876607738375680:0@lo:400: 00000100:00100000:0.0:1789672785.222272:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738374656 00000100:00100000:0.0:1789672785.222277:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738374656 00000100:00100000:0.0:1789672785.222317:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789672785.222332:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738374656:12345-0@lo:400: 00000100:00100000:0.0:1789672785.222372:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738374656:12345-0@lo:400: Request processed in 41us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672785.222379:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1789672785.222401:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672785.222405:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789672785.222552:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738374656:0@lo:400: 00000100:00100000:1.0:1789672785.222623:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738374400:0@lo:400: 00000100:00100000:1.0:1789672785.222678:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.222713:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738374912:0@lo:400: 00000100:00100000:1.0:1789672785.222737:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.222762:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738375424:0@lo:400: 00000100:00100000:1.0:1789672785.222783:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.222814:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789672785.222820:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738374784:0@lo:400: 00000100:00100000:1.0:1789672785.222842:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.222859:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738375296:0@lo:400: 00000100:00100000:1.0:1789672785.222877:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.222903:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738374784 00000100:00100000:1.0:1789672785.222907:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738374784 00000100:00100000:1.0:1789672785.222933:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789672785.222939:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738374784:12345-0@lo:400: 00000100:00100000:1.0:1789672785.222973:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738374784:12345-0@lo:400: Request processed in 34us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672785.222979:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789672785.223005:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738374784:0@lo:400: 00000100:00100000:0.0:1789672785.223072:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738374912 00000100:00100000:0.0:1789672785.223076:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738374912 00000100:00100000:0.0:1789672785.223107:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789672785.223123:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738374912:12345-0@lo:400: 00000100:00100000:0.0:1789672785.223151:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738374912:12345-0@lo:400: Request processed in 29us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672785.223156:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789672785.223404:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738375424 00000100:00100000:3.0:1789672785.223409:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738375424 00000100:00100000:3.0:1789672785.223448:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738375296 00000100:00100000:3.0:1789672785.223452:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738375296 00000100:00080000:0.0:1789672785.223544:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672785.223574:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789672785.223581:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738375424:12345-0@lo:400: 00000100:00100000:0.0:1789672785.223608:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738375424:12345-0@lo:400: Request processed in 29us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672785.223613:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789672785.223746:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789672785.223752:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738375296:12345-0@lo:400: 00000100:00100000:3.0:1789672785.223785:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738375296:12345-0@lo:400: Request processed in 33us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.223795:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789672785.223855:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789672785.224598:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462dd180 x1876607738375296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672785.224613:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738375296:0@lo:400: 00000100:00100000:1.0:1789672785.224626:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738374912:0@lo:400: 00010000:00080000:1.0:1789672785.224650:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462dca80 x1876607738375424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672785.225224:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738375424:0@lo:400: 00000100:00100000:2.0:1789672785.225588:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738374400 00000100:00100000:2.0:1789672785.225604:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738374400 00000100:00100000:2.0:1789672785.225703:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789672785.225711:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:3638:x1876607738374400:12345-0@lo:400: 00000100:00100000:2.0:1789672785.225775:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:3638:x1876607738374400:12345-0@lo:400: Request processed in 66us (3118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672785.225780:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789672785.225842:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738374400:0@lo:400: 10000000:01000000:2.0:1789672785.411790:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789672785.411800:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfb4676b800 from 48 10000000:01000000:2.0:1789672785.411806:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789672785.411857:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672785.411869:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672785.411881:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672785.411905:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738375808:0@lo:101: 00000100:00100000:2.0:1789672785.411994:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.412058:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45b99780 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.412229:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738375808 00000100:00100000:3.0:1789672785.412238:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738375808 00000100:00100000:3.0:1789672785.412294:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789672785.412304:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+15:6509:x1876607738375808:12345-0@lo:101: 00010000:00010000:3.0:1789672785.412319:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672785.412335:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9965048 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9965041 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672785.412361:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9965048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9965041 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672785.412371:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9965048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9965041 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672785.412379:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887400, rc 0) 00000100:00100000:3.0:1789672785.412429:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738375808:12345-0@lo:101: Request processed in 126us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.412436:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789672785.412793:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738375808:0@lo:101: 00010000:00010000:2.0:1789672785.412809:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965048 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672785.412818:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9965048 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672785.412879:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738375936:0@lo:501: 00000100:00100000:2.0:1789672785.412926:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.412990:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45b99780 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.415074:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738375936 00000100:00100000:3.0:1789672785.415090:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738375936 00000100:00100000:3.0:1789672785.415183:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789672785.415195:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738375936:12345-0@lo:501: 00000100:00100000:3.0:1789672785.415424:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738375936:12345-0@lo:501: Request processed in 230us (2498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.415433:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789672785.415918:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738375936:0@lo:501: 00000100:00100000:2.0:1789672785.416006:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738376064:0@lo:503: 00000100:00100000:2.0:1789672785.416070:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.416121:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45b99780 going to sleep for 11 seconds 00000100:00100000:1.0:1789672785.416181:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738376064 00000100:00100000:1.0:1789672785.416188:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738376064 00000100:00100000:1.0:1789672785.416230:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789672785.416239:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738376064:12345-0@lo:503: 00000100:00100000:1.0:1789672785.416344:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738376064:12345-0@lo:503: Request processed in 107us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672785.416351:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789672785.416693:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738376064:0@lo:503: 00000100:00100000:1.0:1789672785.425989:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10344:1876607738376192:0@lo:502: 00000100:00100000:1.0:1789672785.426141:0:10344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.426201:0:10344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4a65b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.426705:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738376192 00000100:00100000:3.0:1789672785.426715:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738376192 00000100:00100000:3.0:1789672785.426776:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789672785.426788:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:10344:x1876607738376192:12345-0@lo:502: 00000100:00100000:3.0:1789672785.426965:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:10344:x1876607738376192:12345-0@lo:502: Request processed in 179us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.426973:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789672785.427276:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10344:1876607738376192:0@lo:502: 00000100:00100000:0.0:1789672785.427353:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10344:1876607738376320:0@lo:502: 00000100:00100000:0.0:1789672785.427394:0:10344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672785.427428:0:10344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.427850:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738376320 00000100:00100000:3.0:1789672785.427858:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738376320 00000100:00100000:3.0:1789672785.427903:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789672785.427912:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:10344:x1876607738376320:12345-0@lo:502: 00000100:00100000:3.0:1789672785.428045:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:10344:x1876607738376320:12345-0@lo:502: Request processed in 133us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.428053:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789672785.428285:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10344:1876607738376320:0@lo:502: 00000040:00080000:2.0:1789672785.428327:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789672785.429422:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789672785.429453:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789672785.429473:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965048 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672785.429727:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965048 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672785.429738:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789672785.429741:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789672785.429744:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789672785.429796:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672785.429805:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672785.429814:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672785.429836:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738376448:0@lo:101: 00000100:00100000:3.0:1789672785.429890:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672785.429929:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935900 going to sleep for 11 seconds 00000100:00100000:2.0:1789672785.430140:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738376448 00000100:00100000:2.0:1789672785.430148:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738376448 00000100:00100000:2.0:1789672785.430199:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789672785.430209:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+16:6509:x1876607738376448:12345-0@lo:101: 00010000:00010000:2.0:1789672785.430222:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672785.430235:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8a1c00/0x6c78c4f8c9965056 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c996504f expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672785.430257:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8a1c00/0x6c78c4f8c9965056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c996504f expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672785.430267:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8a1c00/0x6c78c4f8c9965056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c996504f expref: 17 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672785.430275:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a1c00, rc 0) 00000100:00100000:2.0:1789672785.431069:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738376448:12345-0@lo:101: Request processed in 858us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672785.431076:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789672785.431211:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738376448:0@lo:101: 00010000:00010000:3.0:1789672785.431228:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965056 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672785.431239:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9965056 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672785.431299:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738376576:0@lo:501: 00000100:00100000:3.0:1789672785.431778:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672785.431866:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935900 going to sleep for 11 seconds 00000100:00100000:0.0:1789672785.438639:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738376576 00000100:00100000:0.0:1789672785.438755:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738376576 00000100:00100000:0.0:1789672785.438881:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789672785.438907:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738376576:12345-0@lo:501: 00000100:00100000:0.0:1789672785.439361:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738376576:12345-0@lo:501: Request processed in 455us (7581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672785.439370:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789672785.439500:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738376576:0@lo:501: 00000100:00100000:3.0:1789672785.439572:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738376704:0@lo:503: 00000100:00100000:3.0:1789672785.439619:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672785.447916:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935900 going to sleep for 11 seconds 00000100:00100000:1.0:1789672785.448119:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738376704 00000100:00100000:1.0:1789672785.448132:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738376704 00000100:00100000:1.0:1789672785.448200:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789672785.448210:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738376704:12345-0@lo:503: 00000100:00100000:1.0:1789672785.448400:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738376704:12345-0@lo:503: Request processed in 190us (8780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672785.448408:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789672785.448931:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738376704:0@lo:503: 00000100:00100000:3.0:1789672785.449717:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10345:1876607738376832:0@lo:502: 00000100:00100000:3.0:1789672785.449797:0:10345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672785.449829:0:10345:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d9359c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672785.450269:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738376832 00000100:00100000:1.0:1789672785.450280:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738376832 00000100:00100000:1.0:1789672785.450337:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789672785.450346:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:10345:x1876607738376832:12345-0@lo:502: 00000100:00100000:1.0:1789672785.450815:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:10345:x1876607738376832:12345-0@lo:502: Request processed in 470us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672785.450835:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789672785.451212:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10345:1876607738376832:0@lo:502: 00000020:01000000:3.0:1789672785.451247:0:10345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789672785.451257:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672785.451259:0:10345:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789672785.451265:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789672785.451298:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10345:1876607738376960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672785.451357:0:10345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672785.451385:0:10345:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d9359c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672785.451767:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738376960 00000100:00100000:1.0:1789672785.451774:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738376960 00000100:00100000:1.0:1789672785.451809:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789672785.451818:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:10345:x1876607738376960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672785.451955:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:10345:x1876607738376960:12345-0@lo:502:llog_process_th.0 Request processed in 136us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672785.451962:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789672785.452232:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10345:1876607738376960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789672785.452257:0:10345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789672785.452262:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672785.452264:0:10345:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789672785.452268:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1789672785.452645:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789672785.452705:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789672785.452717:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965056 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672785.452730:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965056 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672785.452742:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789672785.452744:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfc816a3000 from 48 10000000:01000000:1.0:1789672785.452747:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789672785.452781:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672785.452789:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672785.452798:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672785.452817:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738377088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789672785.452863:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.452887:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c604840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.452960:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738377088 00000100:00100000:3.0:1789672785.452968:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738377088 00000100:00100000:3.0:1789672785.452995:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789672785.453002:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+17:6509:x1876607738377088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672785.453013:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672785.453027:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d887000/0x6c78c4f8c9965064 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c996505d expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672785.453048:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d887000/0x6c78c4f8c9965064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c996505d expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672785.453058:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d887000/0x6c78c4f8c9965064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c996505d expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672785.453078:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887000, rc 0) 00000100:00100000:3.0:1789672785.453130:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738377088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.453137:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789672785.453271:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738377088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672785.453284:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965064 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672785.453293:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9965064 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672785.453344:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738377216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672785.453369:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.453394:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c604840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.453433:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738377216 00000100:00100000:3.0:1789672785.453438:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738377216 00000100:00100000:3.0:1789672785.453467:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789672785.453473:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738377216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672785.453875:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738377216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 401us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.453883:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789672785.453962:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738377216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672785.453992:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738377344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672785.454034:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.454061:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c604840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.454169:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738377344 00000100:00100000:3.0:1789672785.454174:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738377344 00000100:00100000:3.0:1789672785.454195:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789672785.454202:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738377344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672785.454295:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738377344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.454302:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789672785.454450:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738377344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672785.455069:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10346:1876607738377472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672785.455126:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.455182:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c604000 going to sleep for 11 seconds 00000100:00100000:2.0:1789672785.455453:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738377472 00000100:00100000:2.0:1789672785.455470:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738377472 00000100:00100000:3.0:1789672785.455784:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789672785.455795:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:10346:x1876607738377472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672785.455976:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:10346:x1876607738377472:12345-0@lo:502:llog_process_th.0 Request processed in 184us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.455982:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789672785.458126:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10346:1876607738377472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672785.458221:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10346:1876607738377600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672785.458299:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.458371:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c604000 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.467048:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738377600 00000100:00100000:3.0:1789672785.467085:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738377600 00000100:00100000:3.0:1789672785.467225:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789672785.467240:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:10346:x1876607738377600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672785.467468:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:10346:x1876607738377600:12345-0@lo:502:llog_process_th.0 Request processed in 220us (9156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.468046:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789672785.468200:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10346:1876607738377600:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789672785.468245:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789672785.472868:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789672785.472918:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789672785.472932:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965064 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.473017:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965064 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672785.473029:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789672785.473032:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789672785.473035:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789672785.473079:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.473087:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.473098:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672785.473138:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738377728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789672785.473216:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672785.473307:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.473394:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738377728 00000100:00100000:3.0:1789672785.473402:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738377728 00000100:00100000:3.0:1789672785.473469:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789672785.473788:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+18:6509:x1876607738377728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672785.473805:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672785.473891:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8a1600/0x6c78c4f8c9965072 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c996506b expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672785.473922:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8a1600/0x6c78c4f8c9965072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c996506b expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672785.473933:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8a1600/0x6c78c4f8c9965072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c996506b expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672785.473956:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a1600, rc 0) 00000100:00100000:2.0:1789672785.474013:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:6509:x1876607738377728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 535us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672785.474020:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789672785.475099:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738377728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672785.475144:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965072 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.475182:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9965072 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672785.475297:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738377856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672785.475358:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672785.475462:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789672785.479206:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738377856 00000100:00100000:2.0:1789672785.479225:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738377856 00000100:00100000:2.0:1789672785.479322:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789672785.479332:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:6509:x1876607738377856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672785.480159:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:6509:x1876607738377856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 825us (4797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672785.480170:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789672785.480757:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738377856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672785.480825:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738377984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672785.480890:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672785.480934:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.481037:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738377984 00000100:00100000:3.0:1789672785.481045:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738377984 00000100:00100000:3.0:1789672785.481088:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789672785.481097:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:6509:x1876607738377984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672785.481230:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:6509:x1876607738377984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.481237:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789672785.481308:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738377984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672785.482274:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10347:1876607738378112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672785.482335:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672785.482372:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.482424:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738378112 00000100:00100000:3.0:1789672785.482430:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738378112 00000100:00100000:2.0:1789672785.482607:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789672785.482619:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:10347:x1876607738378112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789672785.482769:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:10347:x1876607738378112:12345-0@lo:502:llog_process_th.0 Request processed in 152us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672785.482776:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789672785.483046:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10347:1876607738378112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789672785.483070:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672785.483079:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672785.483082:0:10347:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789672785.483087:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789672785.483116:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10347:1876607738378240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672785.483147:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672785.483322:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672785.484307:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738378240 00000100:00100000:1.0:1789672785.484317:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738378240 00000100:00100000:1.0:1789672785.484358:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789672785.484366:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:10347:x1876607738378240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672785.484765:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:10347:x1876607738378240:12345-0@lo:502:llog_process_th.0 Request processed in 399us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672785.484773:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789672785.486195:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10347:1876607738378240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789672785.486290:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672785.486299:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672785.486302:0:10347:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789672785.486308:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1789672785.487763:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789672785.487806:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789672785.487819:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965072 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672785.487832:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965072 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672785.487865:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789672785.487868:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfc7c498000 from 48 10000000:01000000:3.0:1789672785.487871:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789672785.487916:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672785.487925:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672785.487934:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672785.488035:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738378368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789672785.488104:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672785.488161:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc49f5c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789672785.488367:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738378368 00000100:00100000:1.0:1789672785.488376:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738378368 00000100:00100000:1.0:1789672785.488427:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789672785.488437:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:6509:x1876607738378368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672785.488461:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672785.488474:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc61608600/0x6c78c4f8c9965080 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9965079 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672785.488514:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc61608600/0x6c78c4f8c9965080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9965079 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672785.488526:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc61608600/0x6c78c4f8c9965080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9965079 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672785.488535:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc61608600, rc 0) 00000100:00100000:1.0:1789672785.488580:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738378368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672785.488588:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789672785.488629:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738378368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672785.488650:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965080 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672785.488680:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9965080 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672785.488739:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738378496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672785.488765:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.488779:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c604e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789672785.488790:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738378496 00000100:00100000:1.0:1789672785.488794:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738378496 00000100:00100000:1.0:1789672785.488809:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789672785.488814:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738378496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672785.488928:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738378496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672785.488935:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789672785.489842:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738378496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672785.489877:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738378624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672785.489925:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.491223:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c604e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789672785.491264:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738378624 00000100:00100000:1.0:1789672785.491274:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738378624 00000100:00100000:1.0:1789672785.491328:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789672785.491338:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738378624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672785.492325:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738378624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 982us (2393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672785.492352:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789672785.500774:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738378624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672785.503334:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10348:1876607738378752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789672785.503466:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.503871:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805840 going to sleep for 11 seconds 00000100:00100000:0.0:1789672785.509208:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738378752 00000100:00100000:0.0:1789672785.509226:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738378752 00000100:00100000:1.0:1789672785.512256:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789672785.512273:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:10348:x1876607738378752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672785.512564:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:10348:x1876607738378752:12345-0@lo:502:llog_process_th.0 Request processed in 294us (9096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672785.512574:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789672785.512728:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10348:1876607738378752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672785.512828:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10348:1876607738378880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672785.512881:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672785.520270:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc49f5c780 going to sleep for 11 seconds 00000100:00100000:2.0:1789672785.520451:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738378880 00000100:00100000:2.0:1789672785.520474:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738378880 00000100:00100000:2.0:1789672785.520819:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789672785.520830:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:10348:x1876607738378880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789672785.521049:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:10348:x1876607738378880:12345-0@lo:502:llog_process_th.0 Request processed in 221us (8168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672785.521057:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789672785.521270:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10348:1876607738378880:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789672785.521314:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789672785.521922:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789672785.521963:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789672785.521974:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965080 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672785.521986:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965080 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672785.521999:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789672785.522002:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1789672785.522004:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789672785.522046:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672785.522056:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672785.522065:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672785.522103:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738379008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789672785.522176:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.522220:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672785.522349:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738379008 00000100:00100000:1.0:1789672785.522359:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738379008 00000100:00100000:1.0:1789672785.522399:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789672785.522409:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738379008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672785.522421:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672785.522437:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc61609800/0x6c78c4f8c996508e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9965087 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672785.522627:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc61609800/0x6c78c4f8c996508e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9965087 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672785.522642:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc61609800/0x6c78c4f8c996508e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9965087 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672785.522654:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc61609800, rc 0) 00000100:00100000:1.0:1789672785.522747:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738379008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 340us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672785.522755:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789672785.522916:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738379008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672785.522930:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996508e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672785.523005:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996508e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672785.523070:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738379136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672785.523098:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.523134:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.523181:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738379136 00000100:00100000:3.0:1789672785.523185:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738379136 00000100:00100000:3.0:1789672785.523220:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789672785.523228:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738379136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672785.523380:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738379136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.523399:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789672785.523600:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738379136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672785.523636:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738379264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672785.523803:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.523982:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789672785.524131:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738379264 00000100:00100000:0.0:1789672785.524140:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738379264 00000100:00100000:3.0:1789672785.524239:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789672785.524247:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738379264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672785.524414:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738379264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.524422:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789672785.524692:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738379264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672785.525306:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47938380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10349:1876607738379392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672785.525367:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.525444:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c604300 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.525610:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738379392 00000100:00100000:3.0:1789672785.525616:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738379392 00000100:00100000:3.0:1789672785.525719:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789672785.525729:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:10349:x1876607738379392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672785.525861:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:10349:x1876607738379392:12345-0@lo:502:llog_process_th.0 Request processed in 134us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.525869:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789672785.525955:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47938380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10349:1876607738379392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789672785.525986:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672785.525995:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672785.525998:0:10349:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789672785.526004:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789672785.526028:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10349:1876607738379520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789672785.526070:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672785.526227:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672785.526313:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738379520 00000100:00100000:1.0:1789672785.526318:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738379520 00000100:00100000:1.0:1789672785.526341:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789672785.526347:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:10349:x1876607738379520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672785.526425:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:10349:x1876607738379520:12345-0@lo:502:llog_process_th.0 Request processed in 77us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672785.526431:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789672785.526568:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10349:1876607738379520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789672785.526595:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672785.526599:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672785.526601:0:10349:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789672785.526605:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1789672785.527029:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1789672785.527066:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789672785.527078:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996508e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672785.527091:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996508e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672785.527102:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789672785.527135:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfc44f3d800 from 48 10000000:01000000:1.0:1789672785.527138:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789672785.527169:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672785.527178:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672785.527188:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672785.527205:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738379648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789672785.527241:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.527288:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c6046c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.527346:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738379648 00000100:00100000:3.0:1789672785.527351:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738379648 00000100:00100000:3.0:1789672785.527386:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789672785.527394:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738379648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672785.527405:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672785.527418:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d887800/0x6c78c4f8c996509c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9965095 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672785.527439:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d887800/0x6c78c4f8c996509c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9965095 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672785.527450:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d887800/0x6c78c4f8c996509c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9965095 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672785.527600:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887800, rc 0) 00000100:00100000:3.0:1789672785.527646:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738379648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 253us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.527652:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789672785.528041:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738379648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672785.528056:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996509c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672785.528065:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996509c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672785.528133:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738379776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672785.528160:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.528192:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c6046c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672785.528265:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738379776 00000100:00100000:2.0:1789672785.528271:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738379776 00000100:00100000:2.0:1789672785.528295:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789672785.528303:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738379776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672785.528438:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738379776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672785.528446:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789672785.528878:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738379776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672785.528910:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738379904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672785.529033:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.529059:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c6046c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.529102:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738379904 00000100:00100000:3.0:1789672785.529119:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738379904 00000100:00100000:3.0:1789672785.529150:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789672785.529158:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738379904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672785.529253:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738379904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.529261:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789672785.529357:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738379904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672785.530057:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47938380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10350:1876607738380032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672785.530103:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.530143:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c604480 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.530189:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738380032 00000100:00100000:3.0:1789672785.530194:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738380032 00000100:00100000:3.0:1789672785.530228:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789672785.530235:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:10350:x1876607738380032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672785.530340:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:10350:x1876607738380032:12345-0@lo:502:llog_process_th.0 Request processed in 105us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672785.530348:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789672785.530477:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47938380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10350:1876607738380032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672785.530527:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47938380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10350:1876607738380160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672785.530561:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672785.530584:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c604480 going to sleep for 11 seconds 00000100:00100000:0.0:1789672785.530707:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738380160 00000100:00100000:0.0:1789672785.530713:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738380160 00000100:00100000:0.0:1789672785.530740:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789672785.530747:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:10350:x1876607738380160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672785.530839:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:10350:x1876607738380160:12345-0@lo:502:llog_process_th.0 Request processed in 91us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672785.530846:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789672785.530925:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47938380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10350:1876607738380160:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789672785.531023:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789672785.531200:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789672785.531222:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789672785.531233:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996509c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.531244:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996509c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672785.531254:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789672785.531257:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1789672785.531260:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789672785.531286:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.531303:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.531313:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672785.531325:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738380288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789672785.531353:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672785.531382:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672785.531452:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738380288 00000100:00100000:3.0:1789672785.531457:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738380288 00000100:00100000:0.0:1789672785.531572:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789672785.531581:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738380288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672785.531591:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672785.531617:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8cd000/0x6c78c4f8c99650aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99650a3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.531640:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8cd000/0x6c78c4f8c99650aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99650a3 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.531650:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8cd000/0x6c78c4f8c99650aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99650a3 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.531680:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cd000, rc 0) 00000100:00100000:0.0:1789672785.531715:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738380288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672785.531721:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789672785.531752:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738380288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672785.531765:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99650aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.531780:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99650aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672785.531830:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738380416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672785.531855:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672785.531874:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738380416 00000100:00100000:0.0:1789672785.531877:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738380416 00000100:00100000:0.0:1789672785.531893:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789672785.531898:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738380416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672785.532028:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738380416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672785.532035:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789672785.532055:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672785.532065:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738380416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672785.532090:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738380544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672785.532136:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672785.532155:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738380544 00000100:00100000:0.0:1789672785.532158:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738380544 00000100:00100000:0.0:1789672785.532173:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789672785.532179:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738380544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672785.532247:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738380544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672785.532254:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789672785.532286:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672785.532303:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738380544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672785.532508:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10351:1876607738380672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672785.532539:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672785.532557:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738380672 00000100:00100000:0.0:1789672785.532562:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738380672 00000100:00100000:0.0:1789672785.532577:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789672785.532583:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:10351:x1876607738380672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672785.532681:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:10351:x1876607738380672:12345-0@lo:502:llog_process_th.0 Request processed in 75us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672785.532688:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789672785.532715:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672785.532726:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10351:1876607738380672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789672785.532749:0:10351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789672785.532760:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672785.532763:0:10351:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789672785.532769:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789672785.532790:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10351:1876607738380800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672785.532818:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672785.532836:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738380800 00000100:00100000:0.0:1789672785.532839:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738380800 00000100:00100000:0.0:1789672785.532855:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789672785.532859:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:10351:x1876607738380800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672785.532914:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:10351:x1876607738380800:12345-0@lo:502:llog_process_th.0 Request processed in 53us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672785.532920:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789672785.532945:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672785.532961:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10351:1876607738380800:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789672785.532978:0:10351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789672785.532983:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789672785.532984:0:10351:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789672785.532988:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789672785.533074:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1789672785.533088:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789672785.533096:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99650aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.533117:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99650aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672785.533128:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789672785.533130:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cfc499cb380 from 1 10000000:01000000:0.0:1789672785.533133:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789672785.533151:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c99650b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.533159:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c99650b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.533166:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c99650b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672785.533178:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738380928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789672785.533202:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672785.533215:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43e46840 going to sleep for 11 seconds 00000100:00100000:0.0:1789672785.533226:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738380928 00000100:00100000:0.0:1789672785.533230:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738380928 00000100:00100000:0.0:1789672785.533253:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789672785.533258:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738380928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672785.533267:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672785.533280:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c99650b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99650b1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.533297:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c99650b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99650b1 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.533306:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c99650b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99650b1 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.533313:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cc400, rc 0) 00000100:00100000:0.0:1789672785.533338:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738380928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672785.533343:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789672785.533369:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738380928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672785.533379:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c99650b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99650b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.533386:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c99650b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99650b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672785.533426:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738381056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672785.533450:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672785.533463:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43e46840 going to sleep for 11 seconds 00000100:00100000:0.0:1789672785.533473:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738381056 00000100:00100000:0.0:1789672785.533476:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738381056 00000100:00100000:0.0:1789672785.533499:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789672785.533505:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738381056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672785.533560:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738381056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 54us (109us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789672785.533566:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789672785.533592:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738381056:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789672785.533610:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789672785.533615:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c99650b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99650b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672785.533622:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c99650b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99650b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672786.116597:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672786.756312:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738381184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672786.756392:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672786.756693:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738381184 00000100:00100000:2.0:1789672786.756702:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738381184 00000100:00100000:2.0:1789672786.756761:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789672786.756771:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738381184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789672786.756801:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672786.757176:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738381312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789672786.757212:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672786.757274:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738381312 00000100:00100000:3.0:1789672786.757278:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738381312 00000100:00100000:3.0:1789672786.757301:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789672786.757307:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738381312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789672786.757332:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672786.757366:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738381312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672786.757373:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1789672786.757414:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d9f0000 x1876607738381312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672786.757433:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738381312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789672786.758395:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738381184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1621us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672786.758406:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789672786.758628:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47904700 x1876607738381184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672786.758654:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738381184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789672787.139908:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672787.779913:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789672787.779943:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738381440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789672787.780036:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672787.780728:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738381440 00000100:00100000:0.0:1789672787.780741:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738381440 00000100:00100000:0.0:1789672787.780808:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789672787.780819:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738381440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789672787.780862:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789672787.780940:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738381440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672787.780947:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789672787.781102:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738381440:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789672788.165533:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672788.432202:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672788.432324:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714203008 00000100:00100000:2.0:1789672788.432335:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714203008 00000100:00100000:2.0:1789672788.432400:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 244 00000100:00100000:2.0:1789672788.432411:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+8:6171:x1876607714203008:12345-192.168.201.50@tcp:101: 00010000:00010000:2.0:1789672788.432427:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672788.432445:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8a0800/0x6c78c4f8c99650bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24f01 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672788.432476:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8a0800/0x6c78c4f8c99650bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f01 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672788.432488:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8a0800/0x6c78c4f8c99650bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f01 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672788.432497:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a0800, rc 0) 00000100:00100000:2.0:1789672788.432561:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:6171:x1876607714203008:12345-192.168.201.50@tcp:101: Request processed in 151us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672788.432569:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 244 00000100:00100000:3.0:1789672788.440347:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672788.440503:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714203136 00000100:00100000:1.0:1789672788.440516:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714203136 00000100:00100000:1.0:1789672788.440577:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 245 00000100:00100000:1.0:1789672788.440587:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:6171:x1876607714203136:12345-192.168.201.50@tcp:501: 00000100:00100000:1.0:1789672788.440786:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:6171:x1876607714203136:12345-192.168.201.50@tcp:501: Request processed in 199us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672788.440794:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 245 00000100:00100000:1.0:1789672788.449154:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672788.449514:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714203264 00000100:00100000:3.0:1789672788.449526:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714203264 00000100:00100000:3.0:1789672788.449586:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 246 00000100:00100000:3.0:1789672788.449595:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:6171:x1876607714203264:12345-192.168.201.50@tcp:503: 00000100:00100000:3.0:1789672788.449802:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:6171:x1876607714203264:12345-192.168.201.50@tcp:503: Request processed in 207us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672788.449810:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 246 00000100:00100000:0.0:1789672788.462914:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672788.463358:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714203392 00000100:00100000:2.0:1789672788.463371:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714203392 00000100:00100000:2.0:1789672788.463433:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 247 00000100:00100000:2.0:1789672788.463444:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:6667:x1876607714203392:12345-192.168.201.50@tcp:502: 00000100:00100000:2.0:1789672788.463644:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:6667:x1876607714203392:12345-192.168.201.50@tcp:502: Request processed in 201us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672788.463652:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 247 00000100:00100000:0.0:1789672788.469508:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672788.469619:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714203520 00000100:00100000:1.0:1789672788.469630:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714203520 00000100:00100000:1.0:1789672788.469774:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 248 00000100:00100000:1.0:1789672788.469785:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:6667:x1876607714203520:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789672788.469940:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:6667:x1876607714203520:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 156us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672788.469948:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 248 00000100:00100000:1.0:1789672788.476410:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672788.476563:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714203648 00000100:00100000:3.0:1789672788.476574:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714203648 00000100:00100000:3.0:1789672788.476639:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 249 00000100:00100000:3.0:1789672788.476649:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:6171:x1876607714203648:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672788.476691:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672788.476712:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d887e00/0x6c78c4f8c99650c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24f08 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672788.476744:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d887e00/0x6c78c4f8c99650c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f08 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672788.476788:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d887e00/0x6c78c4f8c99650c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f08 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672788.476799:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887e00, rc 0) 00000100:00100000:3.0:1789672788.476866:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6171:x1876607714203648:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 217us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672788.476874:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 249 00000100:00100000:0.0:1789672788.479285:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672788.479489:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714203776 00000100:00100000:1.0:1789672788.479498:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714203776 00000100:00100000:1.0:1789672788.479556:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 250 00000100:00100000:1.0:1789672788.479582:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6171:x1876607714203776:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672788.480877:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6171:x1876607714203776:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 1290us (1592us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789672788.480889:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 250 00000100:00100000:1.0:1789672788.803972:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672788.804009:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738381568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789672788.804100:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672788.804606:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738381568 00000100:00100000:0.0:1789672788.804619:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738381568 00000100:00100000:0.0:1789672788.804708:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789672788.804719:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738381568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789672788.804768:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789672788.804842:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738381568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672788.804849:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789672788.804951:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738381568:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789672789.189263:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672789.458452:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672789.458504:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672789.458549:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672789.458691:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714204288 00000100:00100000:3.0:1789672789.458701:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714204288 00000100:00100000:3.0:1789672789.458782:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:3.0:1789672789.458793:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714204288:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672789.458862:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714204288:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 71us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672789.458869:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00080000:3.0:1789672789.458903:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672789.460069:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672789.460098:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672789.460435:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714204032 00000100:00100000:1.0:1789672789.460444:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714204032 00000100:00100000:1.0:1789672789.460519:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714204160 00000100:00100000:1.0:1789672789.460523:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714204160 00000100:00100000:1.0:1789672789.460545:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:1.0:1789672789.460553:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714204032:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672789.460630:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714204032:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 76us (2188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672789.460638:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:1.0:1789672789.460680:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 73 00000100:00100000:1.0:1789672789.460689:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714204160:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672789.460715:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714204160:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 28us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672789.460721:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 73 00000100:00100000:3.0:1789672789.461696:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714204416 00000100:00100000:3.0:1789672789.461707:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714204416 00000100:00100000:3.0:1789672789.461767:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:3.0:1789672789.461776:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714204416:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672789.461830:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714204416:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 56us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672789.461836:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00080000:0.0:1789672789.462697:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672789.462706:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789672789.462710:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672789.475627:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714203904 00000100:00100000:2.0:1789672789.475643:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714203904 00000100:00100000:3.0:1789672789.476062:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 251 00000100:00100000:3.0:1789672789.476079:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2396:x1876607714203904:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672789.476577:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2396:x1876607714203904:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 498us (18026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672789.476586:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 251 00010000:00010000:3.0:1789672790.212264:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672790.344487:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738381696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672790.344570:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.344670:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738381696 00000100:00100000:3.0:1789672790.344681:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738381696 00000100:00100000:3.0:1789672790.344744:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789672790.344754:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738381696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789672790.344788:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672790.344837:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738381696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.344844:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789672790.344866:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789672790.344898:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb4793b480 x1876607738381696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672790.344917:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738381696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672790.345786:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738381952:0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.345823:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.345848:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738382464:0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.345869:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.345895:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738382976:0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.345929:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.345955:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789672790.345960:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738382080:0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.345983:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.346000:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738382592:0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.346033:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.346052:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738383104:0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.346074:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.346098:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738381952 00000100:00100000:3.0:1789672790.346105:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738381952 00000100:00100000:3.0:1789672790.346132:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738382464 00000100:00100000:3.0:1789672790.346135:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738382464 00000100:00100000:3.0:1789672790.346156:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738382976 00000100:00100000:3.0:1789672790.346159:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738382976 00000100:00100000:3.0:1789672790.346171:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738382592 00000100:00100000:3.0:1789672790.346173:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738382592 00000100:00100000:3.0:1789672790.346184:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738383104 00000100:00100000:3.0:1789672790.346186:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738383104 00000100:00100000:3.0:1789672790.346200:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789672790.346207:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738381952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.346251:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738381952:12345-0@lo:400:kworker.0 Request processed in 44us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.346257:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789672790.346272:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789672790.346278:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738382464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.346307:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738382464:12345-0@lo:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.346313:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789672790.346332:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789672790.346338:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738382976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.347583:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738382976:12345-0@lo:400:kworker.0 Request processed in 1239us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.347595:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789672790.347623:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789672790.347633:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738382592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.347708:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738382592:12345-0@lo:400:kworker.0 Request processed in 78us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.347714:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789672790.347726:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789672790.347732:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738383104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.347760:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738383104:12345-0@lo:400:kworker.0 Request processed in 28us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.347766:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789672790.347795:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738382080 00000100:00100000:3.0:1789672790.347802:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738382080 00000100:00100000:3.0:1789672790.347837:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789672790.347844:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738382080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.347877:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738382080:12345-0@lo:400:kworker.0 Request processed in 34us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.347883:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1789672790.347906:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789672790.349256:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672790.349284:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738382208:0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.349342:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.350309:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738382720:0@lo:400:kworker.0 00000100:00100000:1.0:1789672790.350310:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738381824:0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.350349:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672790.350350:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.350382:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738383232:0@lo:400:kworker.0 00000100:00100000:1.0:1789672790.350382:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738382336:0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.350402:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.350446:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738382720 00000100:00100000:3.0:1789672790.350453:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738382720 00000100:00100000:3.0:1789672790.350502:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738383232 00000100:00100000:3.0:1789672790.350506:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738383232 00000100:00100000:3.0:1789672790.350532:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789672790.350540:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738382720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.350591:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738382720:12345-0@lo:400:kworker.0 Request processed in 50us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.350598:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789672790.350614:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789672790.350621:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738383232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.350651:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738383232:12345-0@lo:400:kworker.0 Request processed in 30us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.350675:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1789672790.350700:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789672790.350703:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672790.350745:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738382080:0@lo:400:kworker.0 00010000:00080000:3.0:1789672790.350764:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47905180 x1876607738382592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672790.350776:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738382592:0@lo:400:kworker.0 00010000:00080000:3.0:1789672790.350791:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47ac0a80 x1876607738383104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672790.350812:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738383104:0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.350830:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738381952:0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.350843:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738382464:0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.350856:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738382976:0@lo:400:kworker.0 00010000:00080000:3.0:1789672790.350897:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47905c00 x1876607738382720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672790.350905:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738382720:0@lo:400:kworker.0 00010000:00080000:3.0:1789672790.350914:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47ac0000 x1876607738383232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672790.350921:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738383232:0@lo:400:kworker.0 00000100:00100000:1.0:1789672790.351312:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672790.351346:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738382848:0@lo:400:kworker.0 00000100:00100000:1.0:1789672790.351368:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672790.351959:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738382208 00000100:00100000:1.0:1789672790.351965:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738382208 00000100:00100000:1.0:1789672790.352004:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789672790.352011:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738382208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672790.352077:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738382208:12345-0@lo:400:kworker.0 Request processed in 66us (2734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672790.352084:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789672790.352327:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738382336 00000100:00100000:3.0:1789672790.352332:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738382336 00000100:00100000:3.0:1789672790.352406:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789672790.352415:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738382336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672790.352452:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738382336:12345-0@lo:400:kworker.0 Request processed in 39us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.352458:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789672790.354679:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738381824 00000100:00100000:1.0:1789672790.354693:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738381824 00000100:00100000:1.0:1789672790.355907:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789672790.355923:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738381824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672790.356041:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738381824:12345-0@lo:400:kworker.0 Request processed in 124us (5690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672790.356049:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789672790.356100:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738382848 00000100:00100000:1.0:1789672790.356108:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738382848 00000100:00100000:1.0:1789672790.356177:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789672790.356184:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738382848:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789672790.357825:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672790.358605:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738382848:12345-0@lo:400:kworker.0 Request processed in 2414us (7229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672790.358618:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789672790.358699:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738383360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789672790.359710:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672790.360355:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738381824:0@lo:400:kworker.0 00000100:00100000:1.0:1789672790.360373:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738382336:0@lo:400:kworker.0 00010000:00080000:1.0:1789672790.360388:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47ac3100 x1876607738382848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672790.360899:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738382848:0@lo:400:kworker.0 00000100:00100000:1.0:1789672790.360973:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738382208:0@lo:400:kworker.0 00000100:00100000:2.0:1789672790.361296:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738383360 00000100:00100000:2.0:1789672790.361305:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738383360 00000100:00100000:2.0:1789672790.361367:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789672790.361377:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738383360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789672790.361406:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672790.361466:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738383360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672790.361473:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1789672790.361926:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47939c00 x1876607738383360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672790.361945:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738383360:0@lo:13:osp-pre-1-1.0 00000020:00000080:0.0:1789672790.420450:0:10389:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeedc90890 20000000:00000080:0.0:1789672790.420476:0:10389:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cfb47955c00 uarg=0000000000000000 20000000:01000000:0.0:1789672790.420526:0:10389:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789672790.420533:0:10389:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789672790.420539:0:10389:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789672790.421092:0:10390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789672790.421335:0:10389:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789672790.425156:0:10389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789672790.425274:0:10389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789672790.425289:0:10389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789672790.425306:0:10389:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789672790.425328:0:10389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c99650cd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672790.425348:0:10389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c9964d69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d62 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672790.425356:0:10389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc427c2400/0x6c78c4f8c9964d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964d70 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672790.425364:0:10389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc52434c00/0x6c78c4f8c9964dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964dc4 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672790.425370:0:10389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c9964ef1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9964eea expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672790.425399:0:10389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc40031000/0x6c78c4f8c9965009 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ec9 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672790.425406:0:10389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c99650cd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672790.425457:0:10389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc40031000/0x6c78c4f8c9965009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ec9 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672790.425473:0:10389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfc40031000/0x6c78c4f8c9965009 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ec9 expref: 9 pid: 6506 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672790.425490:0:10389:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1876607738383488:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672790.426013:0:10389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c9964ef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964eea expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672790.426034:0:10389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c9964ef1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964eea expref: 23 pid: 6507 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672790.426045:0:10389:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1876607738383616:0@lo:104: 00000100:00100000:1.0:1789672790.426091:0:10389:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672790.426187:0:10389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc52434c00/0x6c78c4f8c9964dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964dc4 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672790.426196:0:10389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc52434c00/0x6c78c4f8c9964dcb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964dc4 expref: 23 pid: 6507 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672790.426205:0:10389:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1876607738383744:0@lo:104: 00000100:00100000:1.0:1789672790.426241:0:10389:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672790.426761:0:10389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc427c2400/0x6c78c4f8c9964d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964d70 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672790.426772:0:10389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc427c2400/0x6c78c4f8c9964d77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d70 expref: 23 pid: 6507 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672790.426781:0:10389:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1876607738383872:0@lo:104: 00010000:00010000:1.0:1789672790.426811:0:10389:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c9964d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9964d62 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672790.426818:0:10389:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c9964d69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d62 expref: 23 pid: 6504 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672790.426826:0:10389:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1876607738384000:0@lo:104: 00000100:00100000:1.0:1789672790.426843:0:10389:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c604480 going to sleep for 11 seconds 00000100:00100000:3.0:1789672790.427012:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789672790.427043:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.427057:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.427066:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738383616 00000100:00100000:3.0:1789672790.427073:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738383616 00000100:00100000:3.0:1789672790.427119:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738383744 00000100:00100000:3.0:1789672790.427122:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738383744 00000100:00100000:3.0:1789672790.427131:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738383872 00000100:00100000:3.0:1789672790.427132:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738383872 00000100:00100000:3.0:1789672790.427141:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738384000 00000100:00100000:3.0:1789672790.427143:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738384000 00000100:00100000:3.0:1789672790.427154:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789672790.427359:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+6:10389:x1876607738383616:12345-0@lo:104: 00010000:00010000:3.0:1789672790.427375:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0a00/0x6c78c4f8c9964eea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964ef1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.427526:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789672790.427533:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+6:10389:x1876607738383616:12345-0@lo:104: Request processed in 180us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.427541:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789672790.427560:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789672790.427565:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47955850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:10389:x1876607738383744:12345-0@lo:104: 00010000:00010000:3.0:1789672790.427573:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9964dc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964dcb expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672790.427637:0:10389:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1876607738383616:0@lo:104: 00000100:00100000:1.0:1789672790.427646:0:10389:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1876607738383744:0@lo:104: 00000100:00100000:0.0:1789672790.427746:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:0.0:1789672790.427752:0:6495:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789672790.427760:0:6495:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1789672790.428083:0:10391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789672790.428091:0:10391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:10389:x1876607738383872:12345-0@lo:104: 00010000:00010000:0.0:1789672790.428105:0:10391:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2e00/0x6c78c4f8c9964d70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672790.428208:0:10389:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1876607738383872:0@lo:104: 00010000:00010000:2.0:1789672790.428317:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789672790.428325:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0a00/0x6c78c4f8c9964eea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964ef1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428333:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0a00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:2.0:1789672790.428337:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0a00/0x6c78c4f8c9964eea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964ef1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428346:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0a00/0x6c78c4f8c9964eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964ef1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672790.428353:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0a00/0x6c78c4f8c9964eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964ef1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672790.428359:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789672790.428401:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0a00/0x6c78c4f8c9964eea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964ef1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428409:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672790.428431:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0a00/0x6c78c4f8c9964eea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964ef1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428449:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0a00/0x6c78c4f8c9964eea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964ef1 expref: -99 pid: 9505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428460:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789672790.428463:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9964dc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964dcb expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428468:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61609a00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:2.0:1789672790.428473:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9964dc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964dcb expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428479:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9964dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964dcb expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672790.428485:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9964dc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964dcb expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672790.428490:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789672790.428504:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9964dc4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964dcb expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428510:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672790.428517:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9964dc4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964dcb expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428522:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9964dc4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964dcb expref: -99 pid: 8421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428531:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672790.428539:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2e00/0x6c78c4f8c9964d70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428545:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc427c2e00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:2.0:1789672790.428548:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2e00/0x6c78c4f8c9964d70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428554:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2e00/0x6c78c4f8c9964d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672790.428559:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2e00/0x6c78c4f8c9964d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672790.428564:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789672790.428577:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2e00/0x6c78c4f8c9964d70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428583:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672790.428601:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2e00/0x6c78c4f8c9964d70 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428608:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc427c2e00/0x6c78c4f8c9964d70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d77 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428619:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672790.428620:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672790.428623:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672790.428636:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738384384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672790.428688:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672790.428743:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738384384 00000100:00100000:2.0:1789672790.428749:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738384384 00010000:00010000:2.0:1789672790.428778:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc427c2400/0x6c78c4f8c9964d77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d70 expref: 24 pid: 6507 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672790.428803:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789672790.428809:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738384384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789672790.428820:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672790.428824:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc427c2400/0x6c78c4f8c9964d77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d70 expref: 24 pid: 6507 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428833:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc427c2400/0x6c78c4f8c9964d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d70 expref: 24 pid: 6507 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428847:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc427c2400/0x6c78c4f8c9964d77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964d70 expref: 24 pid: 6507 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672790.428860:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672790.428890:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:3637:x1876607738384384:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672790.428895:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789672790.428937:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738384384:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789672790.429142:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789672790.429152:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47955850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:10389:x1876607738383744:12345-0@lo:104: Request processed in 1585us (2909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.429171:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789672790.429211:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789672790.429219:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:10389:x1876607738384000:12345-0@lo:104: 00010000:00010000:3.0:1789672790.429229:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3800/0x6c78c4f8c9964d62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.429284:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789672790.429290:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:10389:x1876607738384000:12345-0@lo:104: Request processed in 73us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.429297:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789672790.429320:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738384128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789672790.429347:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.429376:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672790.429381:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738384256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789672790.429400:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.429428:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738384128 00000100:00100000:3.0:1789672790.429432:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738384128 00010000:00010000:3.0:1789672790.429447:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c9964ef1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964eea expref: 23 pid: 6507 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672790.429464:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738384256 00000100:00100000:3.0:1789672790.429467:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738384256 00010000:00010000:3.0:1789672790.429478:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc52434c00/0x6c78c4f8c9964dcb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964dc4 expref: 24 pid: 6507 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672790.429491:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789672790.429497:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3635:x1876607738384128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789672790.429504:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672790.429508:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c9964ef1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964eea expref: 24 pid: 6507 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.429517:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c9964ef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964eea expref: 24 pid: 6507 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.429538:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c9964ef1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964eea expref: 24 pid: 6507 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.429547:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672790.429574:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:3635:x1876607738384128:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.429581:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789672790.429593:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789672790.429599:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:3635:x1876607738384256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789672790.429608:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672790.429612:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc52434c00/0x6c78c4f8c9964dcb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964dc4 expref: 22 pid: 6507 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.429620:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc52434c00/0x6c78c4f8c9964dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964dc4 expref: 22 pid: 6507 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.429628:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc52434c00/0x6c78c4f8c9964dcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964dc4 expref: 22 pid: 6507 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.429636:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672790.429675:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3635:x1876607738384256:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.429682:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789672790.429713:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738384256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789672790.429720:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738384128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789672790.429749:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672790.429758:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3800/0x6c78c4f8c9964d62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9964d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.429765:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc427c3800 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:3.0:1789672790.429769:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3800/0x6c78c4f8c9964d62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9964d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.429777:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3800/0x6c78c4f8c9964d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9964d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672790.429783:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3800/0x6c78c4f8c9964d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9964d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672790.429788:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789672790.429808:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3800/0x6c78c4f8c9964d62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.429814:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789672790.429829:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3800/0x6c78c4f8c9964d62 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.429836:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc427c3800/0x6c78c4f8c9964d62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9964d69 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.429848:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672790.429850:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672790.429851:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672790.429859:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738384512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789672790.429881:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672790.429903:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738384512 00000100:00100000:3.0:1789672790.429906:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738384512 00010000:00010000:3.0:1789672790.429923:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c9964d69 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d62 expref: 21 pid: 6504 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672790.429938:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789672790.429943:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc65c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3638:x1876607738384512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789672790.429950:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672790.429953:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c9964d69 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d62 expref: 21 pid: 6504 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.429961:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c9964d69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9964d62 expref: 21 pid: 6504 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.429970:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672790.429991:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc65c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3638:x1876607738384512:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.429997:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789672790.430048:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738384512:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789672790.430202:0:10389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c9964d69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9964d62 expref: 20 pid: 6504 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672790.430212:0:10389:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1876607738384000:0@lo:104: 00010000:00010000:0.0:1789672790.430318:0:10391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1789672790.430326:0:10391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:10389:x1876607738383872:12345-0@lo:104: Request processed in 2235us (3281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672790.430333:0:10391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1789672790.430402:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672790.430441:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672790.431232:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672790.431282:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714204544 00000100:00100000:3.0:1789672790.431287:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714204544 00010000:00010000:3.0:1789672790.431308:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc40031000/0x6c78c4f8c9965009 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ec9 expref: 10 pid: 6506 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672790.431336:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:3.0:1789672790.431343:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2396:x1876607714204544:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672790.431353:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672790.431357:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc40031000/0x6c78c4f8c9965009 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ec9 expref: 10 pid: 6506 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.431380:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc40031000/0x6c78c4f8c9965009 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ec9 expref: 10 pid: 6506 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.431397:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c99650cd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.431406:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c99650cd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.431421:0:7920:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c99650cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.431429:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c99650cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.431436:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c99650cd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.431443:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c99650cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.431448:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61609c00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789672790.431453:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c99650cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.431460:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c99650cd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.431468:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c99650cd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672790.431487:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672790.431536:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2396:x1876607714204544:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 193us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672790.431543:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 39 00010000:00010000:1.0:1789672790.432215:0:10389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc40031000/0x6c78c4f8c9965009 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ec9 expref: 9 pid: 6506 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672790.432231:0:10389:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10389:1876607738383488:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672790.432259:0:10389:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c99650cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672790.432278:0:10389:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c99650cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672790.432285:0:10389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c99650cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672790.432291:0:10389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc61609c00/0x6c78c4f8c99650cd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672791.237256:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672791.876845:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738384640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789672791.876931:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672791.877287:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672791.877297:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738384768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672791.877325:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672791.878858:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738384640 00000100:00100000:0.0:1789672791.878874:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738384640 00000100:00100000:0.0:1789672791.878925:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738384768 00000100:00100000:0.0:1789672791.878928:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738384768 00000100:00100000:0.0:1789672791.878947:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789672791.878958:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738384640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789672791.879007:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672791.879261:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789672791.879272:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738384768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672791.879283:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672791.879344:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738384768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672791.879352:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789672791.879405:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb46803b80 x1876607738384768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672791.879425:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738384768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672791.879619:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738384640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 663us (2688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672791.879626:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1789672791.880827:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb46801f80 x1876607738384640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672791.880863:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738384640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789672791.888552:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672791.888719:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714204672 00000100:00100000:0.0:1789672791.888732:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714204672 00000100:00100000:0.0:1789672791.888787:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 253 00000100:00100000:0.0:1789672791.888799:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:6171:x1876607714204672:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672791.888819:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672791.888845:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8cc600/0x6c78c4f8c99650d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24f0f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672791.888881:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8cc600/0x6c78c4f8c99650d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f0f expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672791.888906:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8cc600/0x6c78c4f8c99650d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f0f expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672791.888918:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cc600, rc 0) 00000100:00100000:0.0:1789672791.889020:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6171:x1876607714204672:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 223us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672791.889028:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 253 00000100:00100000:0.0:1789672791.903202:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672791.903295:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714204800 00000100:00100000:1.0:1789672791.903307:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714204800 00000100:00100000:1.0:1789672791.903371:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 254 00000100:00100000:1.0:1789672791.903382:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6171:x1876607714204800:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672791.903547:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6171:x1876607714204800:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 166us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672791.903555:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 254 00000100:00100000:2.0:1789672791.908716:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672791.908813:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714204928 00000100:00100000:3.0:1789672791.908827:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714204928 00000100:00100000:3.0:1789672791.908895:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 255 00000100:00100000:3.0:1789672791.908907:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6171:x1876607714204928:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672791.909087:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6171:x1876607714204928:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 Request processed in 181us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672791.909095:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 255 00000100:00100000:0.0:1789672791.919211:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672791.919546:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714205056 00000100:00100000:3.0:1789672791.919558:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714205056 00000100:00100000:3.0:1789672791.919623:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 256 00000100:00100000:3.0:1789672791.919637:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6731:x1876607714205056:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789672791.919876:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6731:x1876607714205056:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 241us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672791.919884:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 256 00000100:00100000:2.0:1789672791.924368:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672791.924598:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714205184 00000100:00100000:1.0:1789672791.924612:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714205184 00000100:00100000:1.0:1789672791.924689:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 257 00000100:00100000:1.0:1789672791.924702:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6731:x1876607714205184:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789672791.924868:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:6731:x1876607714205184:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 168us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672791.924877:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 257 00010000:00010000:2.0:1789672792.264625:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789672792.324063:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789672792.324075:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfb4676b800 from 4 10000000:01000000:1.0:1789672792.324081:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789672792.324151:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99650db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.324165:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99650db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672792.324177:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99650db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672792.324221:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738384896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789672792.324300:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672792.324355:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c604900 going to sleep for 11 seconds 00000100:00100000:3.0:1789672792.324457:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738384896 00000100:00100000:3.0:1789672792.324465:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738384896 00000100:00100000:3.0:1789672792.324521:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789672792.324531:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738384896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672792.324544:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672792.324563:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99650e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99650db expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.324589:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99650e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99650db expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.324601:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99650e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99650db expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.324610:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887c00, rc 0) 00000100:00100000:3.0:1789672792.324730:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738384896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.324737:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789672792.326892:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738384896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672792.326923:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99650db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99650e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.328102:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99650db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99650e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672792.329104:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738385024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672792.329508:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672792.329549:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d8059c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672792.329788:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738385024 00000100:00100000:0.0:1789672792.329797:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738385024 00000100:00100000:0.0:1789672792.329849:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789672792.329860:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738385024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672792.330093:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738385024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672792.330101:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789672792.330314:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738385024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672792.330354:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738385152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672792.330402:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672792.330432:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d8059c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672792.331996:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738385152 00000100:00100000:0.0:1789672792.332012:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738385152 00000100:00100000:0.0:1789672792.332077:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789672792.332086:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738385152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672792.332860:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738385152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 772us (2455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672792.332869:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789672792.332972:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738385152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672792.335325:0:10465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10465:1876607738385280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672792.335416:0:10465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672792.335478:0:10465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672792.336695:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738385280 00000100:00100000:2.0:1789672792.336707:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738385280 00000100:00100000:2.0:1789672792.336764:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789672792.336774:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:10465:x1876607738385280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672792.337191:0:10465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10465:1876607738385280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789672792.337228:0:10465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789672792.337239:0:10465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672792.337241:0:10465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789672792.337248:0:10465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfb4676b800 00000020:00000080:3.0:1789672792.337251:0:10465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789672792.337356:0:10465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10465:1876607738385408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672792.337406:0:10465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672792.337439:0:10465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc49f5c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789672792.340372:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:10465:x1876607738385280:12345-0@lo:502:llog_process_th.0 Request processed in 3589us (4945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672792.340386:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789672792.340455:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738385408 00000100:00100000:2.0:1789672792.340463:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738385408 00000100:00100000:2.0:1789672792.340510:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789672792.340518:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:10465:x1876607738385408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789672792.340689:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:10465:x1876607738385408:12345-0@lo:502:llog_process_th.0 Request processed in 172us (3282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672792.340696:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789672792.341271:0:10465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10465:1876607738385408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789672792.341311:0:10465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789672792.341320:0:10465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672792.341322:0:10465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789672792.341327:0:10465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789672792.346751:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789672792.346800:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789672792.346815:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99650db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99650e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.346832:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99650db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99650e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672792.346845:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789672792.346848:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc816a3000 from 4 10000000:01000000:2.0:1789672792.346851:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789672792.346904:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c99650e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.346914:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c99650e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672792.346927:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c99650e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672792.346969:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738385536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789672792.347063:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672792.347114:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672792.348423:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738385536 00000100:00100000:3.0:1789672792.348435:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738385536 00000100:00100000:3.0:1789672792.348483:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789672792.348493:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738385536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672792.348511:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672792.348530:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c99650f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99650e9 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.348559:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c99650f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99650e9 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.348570:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c99650f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99650e9 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.348578:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887600, rc 0) 00000100:00100000:3.0:1789672792.348652:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738385536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.348681:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789672792.348759:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738385536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672792.348776:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c99650e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99650f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.348785:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c99650e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99650f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672792.348859:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738385664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672792.348889:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672792.348917:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc49f5c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672792.348952:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738385664 00000100:00100000:3.0:1789672792.348956:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738385664 00000100:00100000:3.0:1789672792.348979:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789672792.348997:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738385664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672792.349112:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738385664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.349119:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789672792.349341:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738385664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672792.349368:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738385792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672792.349407:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672792.349421:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc49f5c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672792.349433:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738385792 00000100:00100000:3.0:1789672792.349436:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738385792 00000100:00100000:3.0:1789672792.349457:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789672792.349464:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738385792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672792.349535:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738385792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.349541:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789672792.349580:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738385792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672792.353454:0:10468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10468:1876607738385920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672792.353544:0:10468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672792.353581:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738385920 00000100:00100000:3.0:1789672792.353588:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738385920 00000100:00100000:3.0:1789672792.353628:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789672792.353637:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:10468:x1876607738385920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672792.353777:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:10468:x1876607738385920:12345-0@lo:502:llog_process_th.0 Request processed in 140us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.353785:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789672792.353849:0:10468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc49f5c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672792.353872:0:10468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10468:1876607738385920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789672792.353900:0:10468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789672792.353910:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672792.353913:0:10468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789672792.353918:0:10468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfc816a3000 00000020:00000080:3.0:1789672792.353920:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789672792.354363:0:10468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10468:1876607738386048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672792.354404:0:10468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672792.354427:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738386048 00000100:00100000:3.0:1789672792.354432:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738386048 00000100:00100000:3.0:1789672792.354459:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789672792.354465:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:10468:x1876607738386048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672792.354539:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:10468:x1876607738386048:12345-0@lo:502:llog_process_th.0 Request processed in 74us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.354546:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789672792.354576:0:10468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc49f5c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672792.354589:0:10468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10468:1876607738386048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789672792.354607:0:10468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789672792.354612:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789672792.354614:0:10468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789672792.354618:0:10468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789672792.354700:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789672792.354728:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789672792.354739:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c99650e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99650f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.354751:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c99650e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99650f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672792.354761:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789672792.354763:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc7c498000 from 4 10000000:01000000:3.0:1789672792.354766:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789672792.354793:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c99650f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.354803:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c99650f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.354813:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c99650f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672792.354827:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738386176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789672792.354856:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672792.354871:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc49f5c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672792.354886:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738386176 00000100:00100000:3.0:1789672792.354890:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738386176 00000100:00100000:3.0:1789672792.354911:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789672792.354918:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738386176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672792.354927:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672792.354941:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c99650fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99650f7 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.354974:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c99650fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99650f7 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.363757:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c99650fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99650f7 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.363778:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886200, rc 0) 00000100:00100000:3.0:1789672792.363875:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738386176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 8954us (9015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.363884:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789672792.364017:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738386176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672792.364047:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c99650f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99650fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672792.364062:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c99650f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99650fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672792.364169:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738386304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672792.364217:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672792.364253:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc49f5c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672792.364285:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738386304 00000100:00100000:3.0:1789672792.364292:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738386304 00000100:00100000:3.0:1789672792.364331:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789672792.364341:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738386304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672792.364479:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738386304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.364503:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789672792.364535:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738386304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672792.364563:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738386432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672792.364601:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672792.364613:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc49f5c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672792.364623:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738386432 00000100:00100000:3.0:1789672792.364626:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738386432 00000100:00100000:3.0:1789672792.364641:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789672792.364646:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738386432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672792.364748:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738386432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.364755:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789672792.364805:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738386432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672792.366616:0:10470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10470:1876607738386560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672792.366721:0:10470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672792.366760:0:10470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c604900 going to sleep for 11 seconds 00000100:00100000:3.0:1789672792.367244:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738386560 00000100:00100000:3.0:1789672792.367252:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738386560 00000100:00100000:3.0:1789672792.367306:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789672792.367316:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:10470:x1876607738386560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672792.367434:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:10470:x1876607738386560:12345-0@lo:502:llog_process_th.0 Request processed in 119us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.367442:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789672792.367591:0:10470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10470:1876607738386560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672792.367621:0:10470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672792.367630:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672792.367632:0:10470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789672792.367638:0:10470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfc7c498000 00000020:00000080:1.0:1789672792.367641:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789672792.367754:0:10470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10470:1876607738386688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672792.367795:0:10470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672792.367817:0:10470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43a503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672792.368613:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738386688 00000100:00100000:3.0:1789672792.368621:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738386688 00000100:00100000:3.0:1789672792.369374:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789672792.369386:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:10470:x1876607738386688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672792.369529:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:10470:x1876607738386688:12345-0@lo:502:llog_process_th.0 Request processed in 146us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.369537:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789672792.373752:0:10470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10470:1876607738386688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672792.373798:0:10470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672792.373807:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672792.373809:0:10470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789672792.373813:0:10470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789672792.374366:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789672792.374393:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789672792.374405:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c99650f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99650fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.374418:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c99650f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99650fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672792.374429:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789672792.374432:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc44f3d800 from 4 10000000:01000000:0.0:1789672792.374435:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789672792.374472:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9965105 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.374480:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9965105 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.374489:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9965105 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672792.374512:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738386816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789672792.374582:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672792.374623:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789672792.374643:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738386816 00000100:00100000:0.0:1789672792.374649:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738386816 00000100:00100000:0.0:1789672792.374708:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789672792.374718:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738386816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672792.374732:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672792.374744:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8cce00/0x6c78c4f8c996510c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9965105 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.374774:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8cce00/0x6c78c4f8c996510c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9965105 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.374786:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8cce00/0x6c78c4f8c996510c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9965105 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.374794:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cce00, rc 0) 00000100:00100000:0.0:1789672792.374832:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738386816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672792.374839:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789672792.374877:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738386816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672792.374891:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9965105 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996510c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.374899:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9965105 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996510c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672792.376208:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738386944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672792.376260:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672792.376366:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789672792.376456:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738386944 00000100:00100000:3.0:1789672792.376464:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738386944 00000100:00100000:3.0:1789672792.376509:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789672792.376517:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738386944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672792.376648:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738386944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.376675:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789672792.376786:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738386944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672792.376819:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738387072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672792.376861:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672792.376886:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789672792.377004:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738387072 00000100:00100000:3.0:1789672792.377011:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738387072 00000100:00100000:3.0:1789672792.377045:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789672792.377052:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738387072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672792.377276:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738387072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 214us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.377284:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789672792.385688:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738387072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672792.386540:0:10472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10472:1876607738387200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672792.386615:0:10472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672792.386681:0:10472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43a50900 going to sleep for 11 seconds 00000100:00100000:0.0:1789672792.386751:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738387200 00000100:00100000:0.0:1789672792.386764:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738387200 00000100:00100000:0.0:1789672792.386819:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789672792.386828:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:10472:x1876607738387200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789672792.386965:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:10472:x1876607738387200:12345-0@lo:502:llog_process_th.0 Request processed in 137us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672792.386972:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789672792.387366:0:10472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10472:1876607738387200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672792.387391:0:10472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672792.387401:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672792.387403:0:10472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789672792.387410:0:10472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfc44f3d800 00000020:00000080:1.0:1789672792.387413:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789672792.387500:0:10472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10472:1876607738387328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672792.387537:0:10472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672792.387558:0:10472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43a50900 going to sleep for 11 seconds 00000100:00100000:3.0:1789672792.387685:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738387328 00000100:00100000:3.0:1789672792.387690:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738387328 00000100:00100000:3.0:1789672792.387724:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789672792.388774:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:10472:x1876607738387328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672792.389400:0:10472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:10472:1876607738387328:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672792.389784:0:10472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672792.389794:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672792.389796:0:10472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789672792.389801:0:10472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:3.0:1789672792.390439:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:10472:x1876607738387328:12345-0@lo:502:llog_process_th.0 Request processed in 2698us (2891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672792.390452:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000020:01000000:0.0:1789672792.398915:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789672792.398973:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789672792.398998:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9965105 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996510c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672792.399015:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9965105 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996510c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672792.906704:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672792.906730:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738387456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789672792.906818:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672792.907750:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738387456 00000100:00100000:2.0:1789672792.907762:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738387456 00000100:00100000:2.0:1789672792.907822:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789672792.907832:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738387456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789672792.907871:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789672792.907947:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738387456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672792.907967:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789672792.908077:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738387456:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789672793.283879:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672793.930968:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672793.930995:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738387584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789672793.931070:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672793.931198:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738387584 00000100:00100000:3.0:1789672793.931209:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738387584 00000100:00100000:3.0:1789672793.931287:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789672793.931298:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738387584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789672793.931339:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789672793.931389:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738387584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672793.931396:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789672793.931488:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738387584:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789672794.308151:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672794.585873:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672794.585914:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672794.586273:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672794.586305:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714205696 00000100:00100000:2.0:1789672794.586317:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714205696 00000100:00100000:2.0:1789672794.586376:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:2.0:1789672794.586397:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714205696:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672794.586479:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714205696:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 94us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672794.586486:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00080000:2.0:1789672794.586520:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672794.586546:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672794.586703:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672794.586727:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714205440 00000100:00100000:2.0:1789672794.586732:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714205440 00000100:00100000:2.0:1789672794.586770:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714205568 00000100:00100000:2.0:1789672794.586773:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714205568 00000100:00100000:2.0:1789672794.586796:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 80 00000100:00100000:2.0:1789672794.586803:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714205440:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672794.586841:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714205440:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 38us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672794.586847:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 80 00000100:00100000:2.0:1789672794.586863:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 81 00000100:00100000:2.0:1789672794.586869:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2395:x1876607714205568:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672794.586903:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2395:x1876607714205568:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 35us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672794.586910:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 81 00000100:00100000:2.0:1789672794.586962:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714205824 00000100:00100000:2.0:1789672794.586965:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714205824 00000100:00100000:2.0:1789672794.586994:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:2.0:1789672794.587000:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2395:x1876607714205824:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672794.587027:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2395:x1876607714205824:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672794.587034:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00080000:2.0:1789672794.587051:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789672794.587055:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789672794.587057:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672794.591605:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714205312 00000100:00100000:1.0:1789672794.591621:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714205312 00000100:00100000:1.0:1789672794.592423:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 278 00000100:00100000:1.0:1789672794.592442:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2395:x1876607714205312:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672794.592520:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2395:x1876607714205312:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 88us (6605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672794.592528:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 278 00010000:00010000:2.0:1789672795.332609:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672795.464835:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738387712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672795.464915:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672795.464993:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672795.465000:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738387840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789672795.465203:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672795.465253:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738387712 00000100:00100000:1.0:1789672795.465263:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738387712 00000100:00100000:1.0:1789672795.465320:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738387840 00000100:00100000:1.0:1789672795.465323:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738387840 00000100:00100000:1.0:1789672795.465342:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789672795.465351:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738387712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789672795.465384:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672795.465435:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738387712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672795.465443:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789672795.465460:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789672795.465466:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738387840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789672795.465477:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672795.465500:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738387840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672795.465505:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1789672795.465526:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789672795.465559:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb479d3480 x1876607738387840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672795.465594:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738387840:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789672795.465605:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb479d1500 x1876607738387712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672795.465631:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738387712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672795.469297:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738387968:0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.469375:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672795.469424:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738388480:0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.469451:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672795.469470:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738388992:0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.469492:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672795.469519:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789672795.469525:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738388096:0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.469575:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672795.469598:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738388608:0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.469620:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672795.469637:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738389120:0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.469681:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672795.469716:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738388224:0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.469741:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672795.469760:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738388736:0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.469780:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672795.469797:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738389248:0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.469814:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672795.469828:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789672795.469834:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738388352:0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.469852:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672795.469862:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738388864:0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.469878:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672795.469914:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738388480 00000100:00100000:0.0:1789672795.469922:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738388480 00000100:00100000:0.0:1789672795.469982:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738388224 00000100:00100000:0.0:1789672795.469985:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738388224 00000100:00100000:0.0:1789672795.470002:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789672795.470011:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738388480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.470076:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738388480:12345-0@lo:400:kworker.0 Request processed in 65us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672795.470083:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789672795.470108:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789672795.470114:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738388224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.470149:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738388224:12345-0@lo:400:kworker.0 Request processed in 35us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672795.470156:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789672795.470175:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738388992 00000100:00100000:0.0:1789672795.470178:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738388992 00000100:00100000:0.0:1789672795.470213:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738388864 00000100:00100000:0.0:1789672795.470217:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738388864 00000100:00100000:0.0:1789672795.470237:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789672795.470244:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738388992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.470275:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738388992:12345-0@lo:400:kworker.0 Request processed in 32us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672795.470280:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789672795.470291:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789672795.470296:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738388864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.470321:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738388864:12345-0@lo:400:kworker.0 Request processed in 25us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672795.470326:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789672795.470345:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738388096 00000100:00100000:0.0:1789672795.470349:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738388096 00000100:00100000:0.0:1789672795.470367:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738388608 00000100:00100000:0.0:1789672795.470369:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738388608 00000100:00100000:0.0:1789672795.470380:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738389120 00000100:00100000:0.0:1789672795.470382:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738389120 00000100:00100000:0.0:1789672795.470392:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738388736 00000100:00100000:0.0:1789672795.470394:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738388736 00000100:00100000:0.0:1789672795.470404:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738389248 00000100:00100000:0.0:1789672795.470406:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738389248 00000100:00100000:0.0:1789672795.470428:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738388352 00000100:00100000:0.0:1789672795.470431:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738388352 00000100:00100000:0.0:1789672795.470444:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789672795.470449:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738388096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.470478:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738388096:12345-0@lo:400:kworker.0 Request processed in 29us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672795.470483:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789672795.470495:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789672795.470501:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738388608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.470526:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738388608:12345-0@lo:400:kworker.0 Request processed in 26us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672795.470533:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789672795.470544:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789672795.470549:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738389120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.470574:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738389120:12345-0@lo:400:kworker.0 Request processed in 24us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672795.470578:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789672795.470590:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789672795.470595:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738388736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.470620:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738388736:12345-0@lo:400:kworker.0 Request processed in 25us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672795.470624:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789672795.470635:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789672795.470641:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738389248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.470692:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738389248:12345-0@lo:400:kworker.0 Request processed in 52us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672795.470708:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789672795.470720:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789672795.470726:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738388352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.470754:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738388352:12345-0@lo:400:kworker.0 Request processed in 28us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672795.470759:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1789672795.470800:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789672795.470805:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672795.470808:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672795.470849:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738388352:0@lo:400:kworker.0 00010000:00080000:0.0:1789672795.470864:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8cb100 x1876607738388864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672795.470875:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738388864:0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.470884:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738388224:0@lo:400:kworker.0 00010000:00080000:0.0:1789672795.470893:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8caa00 x1876607738388736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672795.470900:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738388736:0@lo:400:kworker.0 00010000:00080000:0.0:1789672795.470908:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8c9880 x1876607738389248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672795.470916:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738389248:0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.470965:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738388096:0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.470976:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738388608:0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.470995:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738389120:0@lo:400:kworker.0 00000100:00100000:0.0:1789672795.471005:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738388480:0@lo:400:kworker.0 00010000:00080000:0.0:1789672795.471015:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8cb800 x1876607738388992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672795.471025:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738388992:0@lo:400:kworker.0 00000100:00100000:2.0:1789672795.474750:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738387968 00000100:00100000:2.0:1789672795.474769:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738387968 00000100:00100000:2.0:1789672795.474993:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789672795.475075:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738387968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672795.475180:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738387968:12345-0@lo:400:kworker.0 Request processed in 177us (5804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672795.475189:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789672795.475249:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738387968:0@lo:400:kworker.0 00010000:00010000:0.0:1789672796.356760:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672796.996988:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738389376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789672796.997060:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672796.997142:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738389376 00000100:00100000:0.0:1789672796.997150:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738389376 00000100:00100000:0.0:1789672796.997201:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789672796.997210:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738389376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789672796.997238:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672796.997282:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738389376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672796.997289:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1789672796.997331:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb48075c00 x1876607738389376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672796.997351:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738389376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789672796.997453:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672796.997464:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738389504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672796.997492:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672796.997536:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738389504 00000100:00100000:3.0:1789672796.997540:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738389504 00000100:00100000:3.0:1789672796.997564:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789672796.997571:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738389504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672796.997584:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672796.997614:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738389504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672796.997620:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789672796.997644:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47ac1f80 x1876607738389504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672796.997676:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738389504:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789672797.379856:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789672797.956920:0:10690:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1789672798.020119:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738389632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672798.020206:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672798.020322:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738389632 00000100:00100000:3.0:1789672798.020337:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738389632 00000100:00100000:3.0:1789672798.020400:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789672798.020410:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738389632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789672798.020446:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789672798.020503:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738389632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672798.020512:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789672798.020546:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738389632:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789672798.406246:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672799.052149:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672799.052174:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738389760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789672799.052252:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672799.052312:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738389760 00000100:00100000:3.0:1789672799.052320:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738389760 00000100:00100000:3.0:1789672799.052364:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789672799.052373:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738389760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789672799.052408:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789672799.052451:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738389760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672799.052459:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789672799.052520:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738389760:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789672799.428157:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672799.724642:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672799.724794:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672799.724820:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672799.724865:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672799.724893:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672799.724895:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714206208 00000100:00100000:1.0:1789672799.724905:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714206208 00000100:00100000:3.0:1789672799.724914:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714206336 00000100:00100000:3.0:1789672799.724917:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714206336 00000100:00100000:3.0:1789672799.724956:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714206464 00000100:00100000:1.0:1789672799.724956:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714206080 00000100:00100000:1.0:1789672799.724959:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714206080 00000100:00100000:3.0:1789672799.724972:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714206464 00000100:00100000:1.0:1789672799.724979:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 88 00000100:00100000:1.0:1789672799.724988:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714206208:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672799.724994:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:3.0:1789672799.725000:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2394:x1876607714206336:12345-192.168.201.50@tcp:9:kworker.0 00000020:00000080:3.0:1789672799.725029:0:8494:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c996501e 00000100:00080000:3.0:1789672799.725039:0:8494:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f57c000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789672799.725063:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714206208:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 75us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672799.725070:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 88 00000100:00100000:1.0:1789672799.725087:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 89 00000100:00100000:1.0:1789672799.725093:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2397:x1876607714206080:12345-192.168.201.50@tcp:400:kworker.0 00000001:00000004:3.0:1789672799.725096:0:8494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789672799.725116:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2397:x1876607714206080:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672799.725122:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 89 00000100:00100000:3.0:1789672799.725221:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+2:2394:x1876607714206336:12345-192.168.201.50@tcp:9:kworker.0 Request processed in 221us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672799.725242:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:3.0:1789672799.725268:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:3.0:1789672799.725274:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2394:x1876607714206464:12345-192.168.201.50@tcp:9:kworker.0 00000020:00000080:3.0:1789672799.725287:0:8494:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9965025 00000100:00080000:3.0:1789672799.725293:0:8494:0:(import.c:65:import_set_state_nolock()) ffff8cfb47a0e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789672799.725337:0:8494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:1.0:1789672799.725350:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672799.725423:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+2:2394:x1876607714206464:12345-192.168.201.50@tcp:9:kworker.0 Request processed in 148us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672799.725430:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00010000:00010000:3.0:1789672799.725532:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789672799.727176:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672799.727188:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672799.727208:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789672799.727211:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789672799.729553:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714205952 00000100:00100000:2.0:1789672799.729568:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714205952 00000100:00100000:2.0:1789672799.729631:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 280 00000100:00100000:2.0:1789672799.729642:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2397:x1876607714205952:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672799.729811:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2397:x1876607714205952:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 170us (5181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672799.729821:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 280 00010000:00010000:1.0:1789672800.451829:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672800.580173:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738389888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672800.580252:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672800.580338:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738389888 00000100:00100000:1.0:1789672800.580347:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738389888 00000100:00100000:1.0:1789672800.580406:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789672800.580417:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738389888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789672800.580449:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672800.580507:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738389888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672800.580514:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1789672800.580536:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789672800.580567:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb479d3480 x1876607738389888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672800.580585:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738389888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672800.581255:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738390016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789672800.581292:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672800.581329:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738390528:0@lo:400:kworker.0 00000100:00100000:1.0:1789672800.581391:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672800.581412:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738391040:0@lo:400:kworker.0 00000100:00100000:1.0:1789672800.581435:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672800.581454:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738391552:0@lo:400:kworker.0 00000100:00100000:1.0:1789672800.581472:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672800.581491:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789672800.581498:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738390144:0@lo:400:kworker.0 00000100:00100000:1.0:1789672800.581526:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672800.581548:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738390656:0@lo:400:kworker.0 00000100:00100000:1.0:1789672800.581572:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672800.581591:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738391168:0@lo:400:kworker.0 00000100:00100000:1.0:1789672800.581612:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672800.581647:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738390528 00000100:00100000:1.0:1789672800.581652:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738390528 00000100:00100000:1.0:1789672800.581711:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789672800.581729:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738390528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672800.581779:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738390528:12345-0@lo:400:kworker.0 Request processed in 52us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672800.581788:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789672800.581810:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738391040 00000100:00100000:1.0:1789672800.581813:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738391040 00000100:00100000:1.0:1789672800.581856:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738391552 00000100:00100000:1.0:1789672800.581859:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738391552 00000100:00100000:1.0:1789672800.581875:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738391168 00000100:00100000:1.0:1789672800.581877:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738391168 00000100:00100000:1.0:1789672800.581891:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789672800.581898:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738391040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672800.582015:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738390016 00000100:00100000:3.0:1789672800.582021:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738390016 00000100:00100000:3.0:1789672800.582048:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789672800.582054:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1876607738390016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789672800.582070:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672800.582106:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1876607738390016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672800.582111:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789672800.582504:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738390272:0@lo:400:kworker.0 00000100:00100000:2.0:1789672800.582570:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672800.582606:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738390784:0@lo:400:kworker.0 00000100:00100000:2.0:1789672800.582629:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672800.582647:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738391296:0@lo:400:kworker.0 00000100:00100000:2.0:1789672800.582687:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672800.582709:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789672800.582715:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738390400:0@lo:400:kworker.0 00000100:00100000:2.0:1789672800.582739:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672800.582758:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738390912:0@lo:400:kworker.0 00000100:00100000:2.0:1789672800.582778:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672800.582789:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738391424:0@lo:400:kworker.0 00000100:00100000:2.0:1789672800.582819:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672800.582855:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738390272 00000100:00100000:2.0:1789672800.582861:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738390272 00000100:00100000:2.0:1789672800.582884:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738390784 00000100:00100000:2.0:1789672800.582886:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738390784 00000100:00100000:2.0:1789672800.582899:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738391296 00000100:00100000:2.0:1789672800.582901:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738391296 00000100:00100000:2.0:1789672800.582912:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738390912 00000100:00100000:2.0:1789672800.582915:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738390912 00000100:00100000:3.0:1789672800.583017:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738391424 00000100:00100000:3.0:1789672800.583022:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738391424 00000100:00100000:3.0:1789672800.583041:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789672800.583049:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738390272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672800.583095:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738390272:12345-0@lo:400:kworker.0 Request processed in 46us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672800.583101:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789672800.583115:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789672800.583121:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738390784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672800.583143:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738390784:12345-0@lo:400:kworker.0 Request processed in 23us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672800.583148:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789672800.583161:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789672800.583167:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738391296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672800.583190:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738391296:12345-0@lo:400:kworker.0 Request processed in 23us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672800.583194:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789672800.583207:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789672800.583212:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738391424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672800.583233:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738391424:12345-0@lo:400:kworker.0 Request processed in 22us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672800.583238:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789672800.584131:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789672800.584139:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738390912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672800.584194:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738390912:12345-0@lo:400:kworker.0 Request processed in 55us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672800.584200:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789672800.584225:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738390656 00000100:00100000:2.0:1789672800.584231:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738390656 00000100:00100000:2.0:1789672800.584256:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738390400 00000100:00100000:2.0:1789672800.584259:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738390400 00000100:00100000:2.0:1789672800.584271:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789672800.584276:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738390656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672800.584309:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738390656:12345-0@lo:400:kworker.0 Request processed in 34us (2737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672800.584315:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789672800.584326:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789672800.584331:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738390400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672800.584356:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738390400:12345-0@lo:400:kworker.0 Request processed in 25us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672800.584361:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789672800.584408:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738390400:0@lo:400:kworker.0 00010000:00080000:2.0:1789672800.584425:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47938e00 x1876607738390912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672800.584436:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738390912:0@lo:400:kworker.0 00010000:00080000:2.0:1789672800.584448:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47904a80 x1876607738391424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672800.584456:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738391424:0@lo:400:kworker.0 00000100:00100000:2.0:1789672800.584468:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738390272:0@lo:400:kworker.0 00000100:00100000:2.0:1789672800.584491:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738390784:0@lo:400:kworker.0 00000100:00100000:2.0:1789672800.584501:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738391296:0@lo:400:kworker.0 00000100:00100000:1.0:1789672800.584631:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738391040:12345-0@lo:400:kworker.0 Request processed in 2732us (3192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672800.584640:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789672800.584674:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789672800.584683:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738391552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672800.584717:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738391552:12345-0@lo:400:kworker.0 Request processed in 37us (3244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672800.584723:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789672800.584735:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789672800.584742:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738391168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672800.584771:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738391168:12345-0@lo:400:kworker.0 Request processed in 31us (3158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672800.584777:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789672800.584803:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738390144 00000100:00100000:1.0:1789672800.584823:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738390144 00000100:00100000:1.0:1789672800.584874:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789672800.584881:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738390144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672800.584913:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738390144:12345-0@lo:400:kworker.0 Request processed in 33us (3387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672800.586094:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:1.0:1789672800.586162:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789672800.586167:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789672800.586170:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789672800.586173:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672800.586215:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738390144:0@lo:400:kworker.0 00000100:00100000:1.0:1789672800.586231:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738390656:0@lo:400:kworker.0 00010000:00080000:1.0:1789672800.586243:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb4793bb80 x1876607738391168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672800.586252:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738391168:0@lo:400:kworker.0 00010000:00080000:1.0:1789672800.586265:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d96dc00 x1876607738390016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672800.586281:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738390016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789672800.586293:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738390528:0@lo:400:kworker.0 00010000:00080000:1.0:1789672800.586303:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb4793b800 x1876607738391040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672800.586310:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738391040:0@lo:400:kworker.0 00010000:00080000:1.0:1789672800.586320:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47904380 x1876607738391552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672800.586344:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738391552:0@lo:400:kworker.0 00010000:00010000:3.0:1789672801.481800:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672802.115903:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789672802.115987:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738391680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672802.116081:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672802.116175:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738391680 00000100:00100000:3.0:1789672802.116184:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738391680 00000100:00100000:3.0:1789672802.116245:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789672802.116255:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738391680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672802.116290:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672802.116346:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738391680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672802.116354:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1789672802.116376:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789672802.116416:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47905500 x1876607738391680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672802.116433:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738391680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672802.116860:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672802.116872:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738391808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789672802.116904:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672802.116951:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738391808 00000100:00100000:3.0:1789672802.116956:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738391808 00000100:00100000:3.0:1789672802.116989:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789672802.116997:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738391808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789672802.117010:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672802.117056:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738391808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672802.117062:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789672802.117078:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789672802.117095:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47905500 x1876607738391808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672802.117108:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738391808:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789672802.499853:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672803.143691:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738391936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789672803.143820:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672803.143893:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738391936 00000100:00100000:2.0:1789672803.143902:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738391936 00000100:00100000:2.0:1789672803.143947:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789672803.143957:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738391936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789672803.143995:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789672803.144059:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738391936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672803.144066:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789672803.144115:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738391936:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1789672803.409009:0:10934:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing yml_node 00010000:00010000:3.0:1789672803.526863:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672804.165939:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789672804.165963:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738392064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789672804.166079:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672804.166173:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738392064 00000100:00100000:0.0:1789672804.166184:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738392064 00000100:00100000:0.0:1789672804.166503:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789672804.166517:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738392064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789672804.166566:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789672804.166621:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738392064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672804.166629:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789672804.166730:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738392064:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789672804.547834:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672804.819549:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672804.819594:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672804.819687:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714206592 00000100:00100000:3.0:1789672804.819699:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714206592 00000100:00100000:3.0:1789672804.819781:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 282 00000100:00100000:3.0:1789672804.819791:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2398:x1876607714206592:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672804.819883:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2398:x1876607714206592:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 83us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672804.819890:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 282 00000100:00100000:2.0:1789672804.820550:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714206720 00000100:00100000:2.0:1789672804.820557:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714206720 00000100:00100000:2.0:1789672804.820687:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 96 00000100:00100000:2.0:1789672804.820696:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714206720:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672804.820747:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714206720:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 53us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672804.820755:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 96 00000100:00080000:3.0:1789672804.821578:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672804.834831:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672804.834941:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714206848 00000100:00100000:1.0:1789672804.834959:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714206848 00000100:00100000:0.0:1789672804.835204:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 97 00000100:00100000:0.0:1789672804.835219:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714206848:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672804.835336:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714206848:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 121us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672804.835348:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 97 00000100:00080000:3.0:1789672804.835553:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:3.0:1789672805.190499:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000020:00000080:3.0:1789672805.190513:0:8423:0:(genops.c:885:class_export_put()) final put ffff8cfc7f57f000/ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000001:00100000:1.0:1789672805.190699:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000020:00000080:1.0:1789672805.190704:0:9507:0:(genops.c:885:class_export_put()) final put ffff8cfb47a08800/ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000020:00000080:2.0:1789672805.190814:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7f57f000/ad795a16-0aa4-4e04-82a0-6f12aab5f2ea for lustre-OST0000 00000020:00000080:2.0:1789672805.190919:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc7f57c000 for lustre-OST0000 00000020:00000080:2.0:1789672805.191102:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb47a08800/ad795a16-0aa4-4e04-82a0-6f12aab5f2ea for lustre-OST0001 00000020:00000080:2.0:1789672805.191124:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb47a0e000 for lustre-OST0001 00010000:00010000:3.0:1789672805.571983:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672805.700147:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738392320:0@lo:400:kworker.0 00000100:00100000:2.0:1789672805.700245:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672805.700305:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738392832:0@lo:400:kworker.0 00000100:00100000:2.0:1789672805.700328:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672805.700357:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738393344:0@lo:400:kworker.0 00000100:00100000:2.0:1789672805.700377:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672805.700764:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789672805.700773:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738392448:0@lo:400:kworker.0 00000100:00100000:2.0:1789672805.700803:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672805.700824:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738392960:0@lo:400:kworker.0 00000100:00100000:2.0:1789672805.700844:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672805.700932:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738393472:0@lo:400:kworker.0 00000100:00100000:2.0:1789672805.700969:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672805.701007:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738392320 00000100:00100000:2.0:1789672805.701016:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738392320 00000100:00100000:2.0:1789672805.701064:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738392832 00000100:00100000:2.0:1789672805.701067:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738392832 00000100:00100000:2.0:1789672805.701088:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738393344 00000100:00100000:2.0:1789672805.701091:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738393344 00000100:00100000:2.0:1789672805.701102:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738392960 00000100:00100000:2.0:1789672805.701105:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738392960 00000100:00100000:2.0:1789672805.701118:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738393472 00000100:00100000:2.0:1789672805.701120:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738393472 00000100:00100000:2.0:1789672805.701141:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789672805.701150:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738392320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672805.701404:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738392576:0@lo:400:kworker.0 00000100:00100000:1.0:1789672805.701442:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672805.701457:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738393088:0@lo:400:kworker.0 00000100:00100000:1.0:1789672805.701483:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672805.701503:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738393600:0@lo:400:kworker.0 00000100:00100000:1.0:1789672805.701523:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672805.701548:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789672805.701555:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738392192:0@lo:400:kworker.0 00000100:00100000:1.0:1789672805.701585:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672805.701609:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738392704:0@lo:400:kworker.0 00000100:00100000:1.0:1789672805.701631:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672805.701648:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738393216:0@lo:400:kworker.0 00000100:00100000:1.0:1789672805.701688:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672805.701720:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738393728:0@lo:400:kworker.0 00000100:00100000:1.0:1789672805.701742:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672805.701852:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738393088 00000100:00100000:0.0:1789672805.702070:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738392448 00000100:00100000:0.0:1789672805.702075:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738392448 00000100:00100000:0.0:1789672805.702112:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738392704 00000100:00100000:0.0:1789672805.702115:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738392704 00000100:00100000:0.0:1789672805.702130:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789672805.702151:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738392448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672805.702215:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738392448:12345-0@lo:400:kworker.0 Request processed in 66us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672805.702223:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789672805.702241:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789672805.702247:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738392704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672805.702279:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738392320:12345-0@lo:400:kworker.0 Request processed in 1129us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672805.702293:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738392704:12345-0@lo:400:kworker.0 Request processed in 46us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672805.702295:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789672805.702298:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789672805.702309:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738392576 00000100:00100000:2.0:1789672805.702312:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738392576 00000100:00100000:2.0:1789672805.702326:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789672805.702332:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738392832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672805.702361:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738392832:12345-0@lo:400:kworker.0 Request processed in 30us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672805.702366:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789672805.702377:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789672805.702383:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738393344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672805.702408:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738393344:12345-0@lo:400:kworker.0 Request processed in 26us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672805.702413:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789672805.702424:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789672805.702430:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738392960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672805.702469:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738392704:0@lo:400:kworker.0 00000100:00100000:0.0:1789672805.702516:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738392192 00000100:00100000:0.0:1789672805.702521:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738392192 00000100:00100000:0.0:1789672805.702556:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789672805.702562:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738392192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672805.702597:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738393088 00000100:00100000:1.0:1789672805.702631:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738393600 00000100:00100000:1.0:1789672805.702634:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738393600 00000100:00100000:1.0:1789672805.702645:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738393216 00000100:00100000:1.0:1789672805.702647:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738393216 00000100:00100000:1.0:1789672805.702674:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738393728 00000100:00100000:1.0:1789672805.702677:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738393728 00000100:00100000:1.0:1789672805.702690:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789672805.702695:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738393088:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789672805.702779:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789672805.702784:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789672805.702787:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789672805.702789:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672805.702803:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789672805.702813:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738393472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672805.711304:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738392192:12345-0@lo:400:kworker.0 Request processed in 8729us (9706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672805.711321:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789672805.711516:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789672805.711602:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738393600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672805.711679:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738393600:12345-0@lo:400:kworker.0 Request processed in 135us (10135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672805.711687:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789672805.711704:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789672805.711712:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc818f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738393216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672805.711742:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc818f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738393216:12345-0@lo:400:kworker.0 Request processed in 31us (10053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672805.711775:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789672805.711787:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789672805.711793:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738393728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672805.711822:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738393728:12345-0@lo:400:kworker.0 Request processed in 30us (10079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672805.711828:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789672805.711849:0:9524:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789672805.711857:0:9524:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789672805.711910:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738392192:0@lo:400:kworker.0 00010000:00080000:0.0:1789672805.712618:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5aca80 x1876607738393216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672805.712633:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738393216:0@lo:400:kworker.0 00010000:00080000:0.0:1789672805.712650:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5af480 x1876607738393728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672805.712683:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738393728:0@lo:400:kworker.0 00010000:00080000:0.0:1789672805.712697:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5ad500 x1876607738393600/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672805.712705:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738393600:0@lo:400:kworker.0 00000100:00100000:1.0:1789672805.713615:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738393856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789672805.713713:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672805.713781:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738392448:0@lo:400:kworker.0 00000100:00100000:1.0:1789672805.713795:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738392320:0@lo:400:kworker.0 00000100:00100000:1.0:1789672805.713808:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738392832:0@lo:400:kworker.0 00000100:00100000:1.0:1789672805.713820:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738393344:0@lo:400:kworker.0 00000100:00100000:1.0:1789672805.713842:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672805.713848:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738393984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672805.713883:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672805.713930:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738393088:12345-0@lo:400:kworker.0 Request processed in 11233us (12445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672805.713940:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789672805.714095:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5af800 x1876607738393088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672805.714105:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738393088:0@lo:400:kworker.0 00000100:00100000:1.0:1789672805.722036:0:6512:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789672805.722070:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789672805.722101:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738392576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672805.722228:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738392576:12345-0@lo:400:kworker.0 Request processed in 133us (20785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672805.722237:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789672805.722301:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738392576:0@lo:400:kworker.0 00000100:00100000:3.0:1789672805.722411:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738393472:12345-0@lo:400:kworker.0 Request processed in 19600us (21440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672805.722419:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789672805.722444:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738393856 00000100:00100000:3.0:1789672805.722451:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738393856 00000100:00100000:3.0:1789672805.722490:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738393984 00000100:00100000:3.0:1789672805.722493:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738393984 00000100:00100000:3.0:1789672805.722504:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789672805.722518:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738393856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789672805.722541:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672805.722570:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738393856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (8858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672805.722575:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789672805.722586:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789672805.722590:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738393984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789672805.722598:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672805.722614:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738393984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 24us (8731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672805.722619:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789672805.722646:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d9f0a80 x1876607738393984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672805.722684:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738393984:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789672805.722698:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb479d2d80 x1876607738393856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672805.722708:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738393856:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789672805.722720:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5aed80 x1876607738393472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672805.722728:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738393472:0@lo:400:kworker.0 00000100:00100000:2.0:1789672805.729370:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738392960:12345-0@lo:400:kworker.0 Request processed in 26928us (28513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672805.729386:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1789672805.729782:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47904a80 x1876607738392960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672805.729799:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738392960:0@lo:400:kworker.0 00010000:00010000:0.0:1789672806.595791:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672807.240227:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672807.240257:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738394112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789672807.240341:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672807.240422:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738394112 00000100:00100000:3.0:1789672807.240431:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738394112 00000100:00100000:3.0:1789672807.240488:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789672807.240498:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738394112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789672807.240530:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672807.240576:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738394112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672807.240584:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1789672807.240605:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789672807.240650:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5aed80 x1876607738394112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672807.240689:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738394112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789672807.241578:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738394240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672807.241963:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672807.242106:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738394240 00000100:00100000:0.0:1789672807.242114:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738394240 00000100:00100000:0.0:1789672807.242173:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789672807.242182:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738394240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672807.242207:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672807.242265:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738394240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672807.242271:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1789672807.243397:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789672807.243444:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb48077b80 x1876607738394240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672807.243467:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738394240:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789672807.448532:0:11118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:1.0:1789672807.625768:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672808.273314:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789672808.273345:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738394368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789672808.273429:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672808.273965:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738394368 00000100:00100000:3.0:1789672808.273977:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738394368 00000100:00100000:3.0:1789672808.274035:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789672808.274046:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738394368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789672808.274094:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789672808.274152:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738394368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672808.274159:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789672808.274207:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738394368:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789672808.646681:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672809.288933:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672809.288959:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738394496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789672809.289053:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672809.289172:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738394496 00000100:00100000:1.0:1789672809.289180:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738394496 00000100:00100000:1.0:1789672809.289242:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789672809.289250:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738394496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789672809.289291:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789672809.289339:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738394496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672809.289347:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789672809.289396:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738394496:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789672809.677778:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672809.955020:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672809.955063:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672809.955108:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672809.955139:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714207232 00000100:00100000:0.0:1789672809.955149:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714207232 00000100:00100000:0.0:1789672809.955205:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714207104 00000100:00100000:0.0:1789672809.955208:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714207104 00000100:00100000:0.0:1789672809.955233:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 104 00000100:00100000:0.0:1789672809.955244:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714207232:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672809.955322:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714207232:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 78us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672809.955329:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 104 00000100:00100000:0.0:1789672809.955347:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 105 00000100:00100000:0.0:1789672809.955354:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2397:x1876607714207104:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672809.955381:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2397:x1876607714207104:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 27us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672809.955386:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 105 00000100:00080000:0.0:1789672809.955403:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672809.955406:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789672809.955865:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714206976 00000100:00100000:1.0:1789672809.955871:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714206976 00000100:00100000:1.0:1789672809.955912:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 284 00000100:00100000:1.0:1789672809.955920:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2397:x1876607714206976:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672809.955958:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2397:x1876607714206976:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 39us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672809.955965:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 284 00000001:02000400:3.0:1789672810.070220:0:11215:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:2.0:1789672810.699255:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672810.820146:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738394624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672810.820219:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672810.820244:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738394880:0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.820275:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672810.820286:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738395136:0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.820291:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738395392:0@lo:400:kworker.0 00000100:00100000:3.0:1789672810.820306:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672810.820320:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672810.820322:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738395648:0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.820336:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738395904:0@lo:400:kworker.0 00000100:00100000:3.0:1789672810.820341:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672810.820353:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672810.820355:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738396160:0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.820369:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789672810.820372:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672810.820375:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738395008:0@lo:400:kworker.0 00000100:00100000:3.0:1789672810.820393:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789672810.820395:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672810.820398:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738394752:0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.820410:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738395520:0@lo:400:kworker.0 00000100:00100000:3.0:1789672810.820424:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672810.820427:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672810.820443:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738395264:0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.820443:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738396032:0@lo:400:kworker.0 00000100:00100000:3.0:1789672810.820460:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672810.820460:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672810.820474:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738395776:0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.820485:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738394880 00000100:00100000:3.0:1789672810.820490:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672810.820492:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738394880 00000100:00100000:3.0:1789672810.820505:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738396288:0@lo:400:kworker.0 00000100:00100000:3.0:1789672810.820519:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672810.820527:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738395136 00000100:00100000:0.0:1789672810.820530:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738395136 00000100:00100000:0.0:1789672810.820541:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738395392 00000100:00100000:0.0:1789672810.820544:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738395392 00000100:00100000:3.0:1789672810.820554:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738394624 00000100:00100000:3.0:1789672810.820557:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738394624 00000100:00100000:0.0:1789672810.820563:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738395904 00000100:00100000:0.0:1789672810.820565:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738395904 00000100:00100000:0.0:1789672810.820576:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738395520 00000100:00100000:0.0:1789672810.820578:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738395520 00000100:00100000:3.0:1789672810.820583:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789672810.820588:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738396032 00000100:00100000:0.0:1789672810.820590:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738396032 00000100:00100000:3.0:1789672810.820592:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738394624:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672810.820602:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789672810.820607:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738394880:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789672810.820622:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672810.820647:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738394880:12345-0@lo:400:kworker.0 Request processed in 40us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672810.820652:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738394624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672810.820692:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789672810.820694:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789672810.820709:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789672810.820714:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738395008 00000100:00100000:3.0:1789672810.820718:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738395008 00000100:00100000:0.0:1789672810.820720:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738395136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672810.820738:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738395264 00000100:00100000:3.0:1789672810.820741:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738395264 00000100:00100000:0.0:1789672810.820748:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738395136:12345-0@lo:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672810.820754:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789672810.820754:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789672810.820759:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738395008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.820766:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789672810.820771:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738395392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672810.820790:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738395008:12345-0@lo:400:kworker.0 Request processed in 30us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672810.820790:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738395392:12345-0@lo:400:kworker.0 Request processed in 20us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672810.820795:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789672810.820807:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789672810.820809:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789672810.820813:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738395904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672810.820819:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789672810.820824:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738395264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.820835:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738395904:12345-0@lo:400:kworker.0 Request processed in 23us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672810.820841:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789672810.820852:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789672810.820857:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738395520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.820881:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738395520:12345-0@lo:400:kworker.0 Request processed in 24us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672810.820886:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789672810.820897:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789672810.820902:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738396032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.820925:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738396032:12345-0@lo:400:kworker.0 Request processed in 23us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672810.820930:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789672810.820951:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738395648 00000100:00100000:0.0:1789672810.820960:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738395648 00000100:00100000:0.0:1789672810.820978:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738396160 00000100:00100000:0.0:1789672810.820980:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738396160 00000100:00100000:0.0:1789672810.820990:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738395776 00000100:00100000:0.0:1789672810.820992:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738395776 00000100:00100000:0.0:1789672810.821001:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738396288 00000100:00100000:0.0:1789672810.821003:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738396288 00000100:00100000:0.0:1789672810.821013:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789672810.821018:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738395648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.821047:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738395648:12345-0@lo:400:kworker.0 Request processed in 29us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672810.821053:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789672810.821063:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789672810.821068:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738396160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.821094:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738396160:12345-0@lo:400:kworker.0 Request processed in 26us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672810.821100:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789672810.821111:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789672810.821116:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738395776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.821141:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738395776:12345-0@lo:400:kworker.0 Request processed in 24us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672810.821146:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789672810.821157:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789672810.821162:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738396288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.821188:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738396288:12345-0@lo:400:kworker.0 Request processed in 27us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672810.821193:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789672810.821231:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738394752 00000100:00100000:0.0:1789672810.821235:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738394752 00000100:00100000:0.0:1789672810.821265:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789672810.821270:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738394752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.821300:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738394752:12345-0@lo:400:kworker.0 Request processed in 29us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672810.821305:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:0.0:1789672810.821337:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789672810.821342:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789672810.821344:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672810.821346:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672810.821401:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738395008:0@lo:400:kworker.0 00010000:00080000:0.0:1789672810.821414:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47904a80 x1876607738395520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672810.821425:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738395520:0@lo:400:kworker.0 00010000:00080000:0.0:1789672810.821435:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47904000 x1876607738396032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672810.821443:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738396032:0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.821451:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738394880:0@lo:400:kworker.0 00000100:00100000:0.0:1789672810.821460:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738395392:0@lo:400:kworker.0 00000100:00100000:3.0:1789672810.821462:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738395264:12345-0@lo:400:kworker.0 Request processed in 638us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672810.821468:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738395904:0@lo:400:kworker.0 00000100:00100000:3.0:1789672810.821469:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789672810.821497:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738394752:0@lo:400:kworker.0 00000100:00100000:3.0:1789672810.821506:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738395264:0@lo:400:kworker.0 00010000:00080000:3.0:1789672810.821515:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47904380 x1876607738395776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672810.821537:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738395776:0@lo:400:kworker.0 00010000:00080000:3.0:1789672810.821551:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47906d80 x1876607738396288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672810.821557:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738396288:0@lo:400:kworker.0 00000100:00100000:3.0:1789672810.821565:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738395136:0@lo:400:kworker.0 00010000:00080000:3.0:1789672810.821573:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47905180 x1876607738395648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672810.821579:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738395648:0@lo:400:kworker.0 00010000:00080000:3.0:1789672810.821587:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47905c00 x1876607738396160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672810.821594:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738396160:0@lo:400:kworker.0 00010000:00080000:3.0:1789672810.821602:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5ac380 x1876607738394624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672810.821614:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738394624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672810.821903:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789672810.821912:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738396416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789672810.821944:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672810.821975:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738396416 00000100:00100000:1.0:1789672810.821979:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738396416 00000100:00100000:1.0:1789672810.822002:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789672810.822008:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738396416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789672810.822019:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672810.822048:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738396416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672810.822054:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1789672810.822083:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d868000 x1876607738396416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672810.822095:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738396416:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789672811.717169:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672812.356606:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738396544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789672812.356720:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672812.356828:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738396544 00000100:00100000:1.0:1789672812.356837:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738396544 00000100:00100000:1.0:1789672812.356894:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789672812.356905:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738396544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789672812.356938:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672812.356986:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738396544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672812.356994:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1789672812.357017:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789672812.357049:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5ac380 x1876607738396544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672812.357087:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738396544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789672812.359703:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738396672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672812.359780:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672812.359871:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738396672 00000100:00100000:0.0:1789672812.359881:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738396672 00000100:00100000:0.0:1789672812.359957:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789672812.359966:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738396672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672812.360001:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789672812.360973:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672812.362836:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738396672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2861us (3045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672812.362852:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1789672812.362959:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d86b480 x1876607738396672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672812.362986:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738396672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789672812.743282:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789672812.961117:0:11313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:2.0:1789672813.380037:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738396800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789672813.380133:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672813.380437:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738396800 00000100:00100000:3.0:1789672813.380452:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738396800 00000100:00100000:3.0:1789672813.380514:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789672813.380525:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738396800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789672813.380575:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789672813.380641:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738396800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672813.380648:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789672813.380865:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738396800:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789672813.764059:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672814.405559:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672814.410085:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738396928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789672814.410341:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672814.410556:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738396928 00000100:00100000:3.0:1789672814.410566:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738396928 00000100:00100000:3.0:1789672814.410637:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789672814.410651:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738396928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789672814.410714:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789672814.410777:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738396928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672814.410785:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789672814.410878:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738396928:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789672814.788045:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789672815.043008:0:11361:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 17 15:20:11 EDT 2026 00000100:00100000:0.0:1789672815.060936:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672815.060982:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672815.061023:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672815.061056:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714207616 00000100:00100000:0.0:1789672815.061066:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714207616 00000100:00100000:0.0:1789672815.061123:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714207488 00000100:00100000:0.0:1789672815.061127:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714207488 00000100:00100000:0.0:1789672815.061152:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 112 00000100:00100000:0.0:1789672815.061163:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714207616:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672815.061236:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714207616:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 74us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672815.061244:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 112 00000100:00100000:0.0:1789672815.061261:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 113 00000100:00100000:0.0:1789672815.061268:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714207488:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672815.061294:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714207488:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 26us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672815.061313:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 113 00000100:00080000:0.0:1789672815.061333:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672815.061338:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789672815.061691:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714207360 00000100:00100000:2.0:1789672815.061698:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714207360 00000100:00100000:2.0:1789672815.061747:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 286 00000100:00100000:2.0:1789672815.061755:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2396:x1876607714207360:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672815.061786:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2396:x1876607714207360:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 32us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672815.061792:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 286 00010000:00010000:3.0:1789672815.811977:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672815.940451:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738397056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789672815.940561:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672815.941028:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672815.941038:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738397184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672815.941075:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672815.941256:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738397056 00000100:00100000:1.0:1789672815.941266:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738397056 00000100:00080000:2.0:1789672815.941318:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789672815.941340:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738397184 00000100:00100000:1.0:1789672815.941343:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738397184 00000100:00100000:2.0:1789672815.941348:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789672815.941358:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738397056:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789672815.941366:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789672815.941371:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738397184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789672815.941394:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1789672815.941394:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672815.941442:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738397056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672815.941442:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738397184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672815.941449:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1789672815.941530:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d869180 x1876607738397056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672815.941557:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738397056:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789672815.942018:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789672815.942037:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47939500 x1876607738397184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672815.942051:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738397184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672815.942206:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738397312:0@lo:400:kworker.0 00000100:00100000:3.0:1789672815.942249:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672815.942338:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672815.942344:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738397696:0@lo:400:kworker.0 00000100:00100000:3.0:1789672815.942371:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672815.942401:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738397312 00000100:00100000:3.0:1789672815.942411:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738397312 00000100:00100000:3.0:1789672815.942443:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789672815.942450:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738397312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672815.942499:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738397312:12345-0@lo:400:kworker.0 Request processed in 49us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672815.942505:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789672815.942540:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738397696 00000100:00100000:3.0:1789672815.942544:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738397696 00000100:00100000:3.0:1789672815.942586:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789672815.942592:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738397696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672815.942620:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738397696:12345-0@lo:400:kworker.0 Request processed in 29us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672815.942636:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789672815.942677:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738397440:0@lo:400:kworker.0 00000100:00100000:3.0:1789672815.942700:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672815.942718:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672815.942723:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738397568:0@lo:400:kworker.0 00000100:00100000:3.0:1789672815.942743:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672815.942763:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738397440 00000100:00100000:3.0:1789672815.942765:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738397440 00000100:00100000:3.0:1789672815.942799:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789672815.942805:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738397440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672815.942834:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738397440:12345-0@lo:400:kworker.0 Request processed in 29us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672815.942840:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789672815.942857:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738397568 00000100:00100000:3.0:1789672815.942859:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738397568 00000100:00100000:3.0:1789672815.942886:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789672815.942891:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738397568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672815.942919:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738397568:12345-0@lo:400:kworker.0 Request processed in 28us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672815.942924:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789672815.942956:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738397568:0@lo:400:kworker.0 00000100:00100000:3.0:1789672815.942965:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738397440:0@lo:400:kworker.0 00000100:00100000:3.0:1789672815.942984:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738397696:0@lo:400:kworker.0 00000100:00100000:3.0:1789672815.942991:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738397312:0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.943930:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738398208:0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.943979:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672815.944008:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789672815.944013:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738397824:0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.944035:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672815.944065:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738398336:0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.944086:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672815.944114:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738398208 00000100:00100000:2.0:1789672815.944120:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738398208 00000100:00100000:2.0:1789672815.944159:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738398336 00000100:00100000:2.0:1789672815.944162:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738398336 00000100:00100000:2.0:1789672815.944185:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789672815.944194:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738398208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.944238:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738398208:12345-0@lo:400:kworker.0 Request processed in 46us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672815.944246:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789672815.944262:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789672815.944268:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738398336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.944297:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738398336:12345-0@lo:400:kworker.0 Request processed in 30us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672815.944302:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789672815.944318:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738397824 00000100:00100000:2.0:1789672815.944322:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738397824 00000100:00100000:2.0:1789672815.944346:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789672815.944352:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738397824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.944383:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738397824:12345-0@lo:400:kworker.0 Request processed in 31us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672815.944397:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1789672815.944424:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672815.944450:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738397824:0@lo:400:kworker.0 00010000:00080000:2.0:1789672815.944461:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb46800700 x1876607738398336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672815.944488:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738398336:0@lo:400:kworker.0 00010000:00080000:2.0:1789672815.944499:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb46803480 x1876607738398208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672815.944507:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46803480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738398208:0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.944573:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738397952:0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.944601:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672815.944620:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738398464:0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.944652:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672815.944693:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789672815.944699:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738398080:0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.944719:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672815.944735:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738398592:0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.944753:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672815.944794:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738397952 00000100:00100000:2.0:1789672815.944798:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738397952 00000100:00100000:2.0:1789672815.944845:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738398464 00000100:00100000:2.0:1789672815.944849:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738398464 00000100:00100000:2.0:1789672815.944861:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738398080 00000100:00100000:2.0:1789672815.944864:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738398080 00000100:00100000:2.0:1789672815.944886:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738398592 00000100:00100000:2.0:1789672815.944889:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738398592 00000100:00100000:2.0:1789672815.944902:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789672815.944908:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738397952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.944946:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738397952:12345-0@lo:400:kworker.0 Request processed in 38us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672815.944953:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789672815.944964:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789672815.944971:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738398464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.944998:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738398464:12345-0@lo:400:kworker.0 Request processed in 28us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672815.945005:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789672815.945017:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789672815.945023:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738398080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.945050:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738398080:12345-0@lo:400:kworker.0 Request processed in 27us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672815.945055:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789672815.945066:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789672815.945072:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738398592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.945097:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738398592:12345-0@lo:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672815.945103:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1789672815.945124:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789672815.945127:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789672815.945147:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d96df80 x1876607738398080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672815.945169:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738398080:0@lo:400:kworker.0 00010000:00080000:2.0:1789672815.945180:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb46803b80 x1876607738398592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672815.945189:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738398592:0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.945198:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738397952:0@lo:400:kworker.0 00000100:00100000:2.0:1789672815.945206:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738398464:0@lo:400:kworker.0 00000100:00100000:1.0:1789672815.950546:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:3.0:1789672816.837439:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672817.477622:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738398720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672817.477792:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672817.480993:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738398720 00000100:00100000:1.0:1789672817.481017:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738398720 00000100:00100000:1.0:1789672817.481116:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789672817.481129:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738398720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672817.481173:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672817.481291:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738398720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (3498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672817.481299:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1789672817.481363:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d868380 x1876607738398720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672817.481390:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738398720:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789672817.482158:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672817.482365:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738398848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789672817.482444:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672817.485845:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738398848 00000100:00100000:1.0:1789672817.485884:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738398848 00000100:00100000:1.0:1789672817.485975:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789672817.485988:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738398848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789672817.486769:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789672817.488743:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672817.491144:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738398848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5140us (8680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672817.491166:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1789672817.492390:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5af800 x1876607738398848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672817.492644:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738398848:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789672817.860797:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672818.502950:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738398976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789672818.503060:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672818.503566:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738398976 00000100:00100000:1.0:1789672818.503580:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738398976 00000100:00100000:1.0:1789672818.503702:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789672818.503717:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738398976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789672818.503773:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789672818.511755:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738398976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672818.511854:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738398976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8136us (8789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672818.511869:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:3.0:1789672818.892863:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672819.525266:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738399104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789672819.525407:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672819.525691:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738399104 00000100:00100000:1.0:1789672819.525703:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738399104 00000100:00100000:1.0:1789672819.525787:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789672819.525800:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45826050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738399104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789672819.525856:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789672819.525935:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45826050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738399104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672819.525944:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789672819.527513:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738399104:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789672819.908187:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672820.179362:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672820.179419:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672820.179466:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672820.179586:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714208000 00000100:00100000:1.0:1789672820.179600:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714208000 00000100:00100000:2.0:1789672820.179702:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714207872 00000100:00100000:2.0:1789672820.179708:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714207872 00000100:00100000:1.0:1789672820.179735:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00100000:3.0:1789672820.179794:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714207744 00000100:00100000:3.0:1789672820.179799:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714207744 00000100:00100000:3.0:1789672820.179833:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 288 00000100:00100000:3.0:1789672820.179842:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2398:x1876607714207744:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672820.179940:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2398:x1876607714207744:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 99us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672820.179970:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 288 00000100:00080000:0.0:1789672820.180077:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672820.180082:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789672820.180553:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714208000:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672820.180625:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714208000:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 881us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672820.183432:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 121 00000100:00100000:2.0:1789672820.183473:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714207872:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672820.183604:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714207872:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 154us (4135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672820.183613:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 121 00000100:00100000:1.0:1789672820.202609:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 120 00010000:00010000:3.0:1789672820.933152:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672821.060088:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738399232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672821.060200:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672821.060327:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738399232 00000100:00100000:2.0:1789672821.060340:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738399232 00000100:00100000:2.0:1789672821.060847:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789672821.060865:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738399232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789672821.060907:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672821.061085:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738399232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 226us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672821.061093:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1789672821.061144:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789672821.061162:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738399360:0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.061200:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672821.061294:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738399872:0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.066249:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672821.066328:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738400384:0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.066390:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672821.066427:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738400896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789672821.066455:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672821.066526:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738399872 00000100:00100000:0.0:1789672821.066542:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738399872 00000100:00100000:2.0:1789672821.066575:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789672821.066588:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d869880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738399744:0@lo:400:kworker.0 00000100:00100000:0.0:1789672821.066641:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789672821.066649:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672821.066706:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738399872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.066726:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738400256:0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.066754:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672821.066777:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738400768:0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.066818:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672821.066835:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738399872:12345-0@lo:400:kworker.0 Request processed in 176us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672821.066845:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789672821.066874:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d868700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738399872:0@lo:400:kworker.0 00010000:00080000:2.0:1789672821.067454:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb46800700 x1876607738399232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672821.067486:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46800700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738399232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672821.067514:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738399488:0@lo:400:kworker.0 00000100:00100000:1.0:1789672821.067527:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738399360 00000100:00100000:1.0:1789672821.067537:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738399360 00000100:00100000:2.0:1789672821.067554:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672821.067594:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d869f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738400000:0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.067621:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672821.067646:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738400512:0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.067696:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672821.067777:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789672821.067784:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738399616:0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.067810:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672821.067830:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738400128:0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.067852:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672821.067872:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738400640:0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.067966:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672821.068004:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738400384 00000100:00100000:2.0:1789672821.068011:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738400384 00000100:00100000:2.0:1789672821.068066:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738400256 00000100:00100000:2.0:1789672821.068070:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738400256 00000100:00100000:2.0:1789672821.068094:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738400768 00000100:00100000:2.0:1789672821.068098:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738400768 00000100:00100000:2.0:1789672821.068119:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789672821.068128:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738400384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672821.068578:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789672821.068594:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738399360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672821.068821:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738399360:12345-0@lo:400:kworker.0 Request processed in 231us (7619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672821.068830:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789672821.069093:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738399744 00000100:00100000:0.0:1789672821.069103:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738399744 00000100:00100000:0.0:1789672821.069136:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738399488 00000100:00100000:0.0:1789672821.069139:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738399488 00000100:00100000:0.0:1789672821.069152:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738400000 00000100:00100000:0.0:1789672821.069155:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738400000 00000100:00100000:0.0:1789672821.069172:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738400512 00000100:00100000:0.0:1789672821.069175:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738400512 00000100:00100000:0.0:1789672821.069189:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738400128 00000100:00100000:0.0:1789672821.069191:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738400128 00000100:00100000:0.0:1789672821.069220:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738400640 00000100:00100000:0.0:1789672821.069224:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738400640 00000100:00100000:0.0:1789672821.069241:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789672821.069250:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738399744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672821.069300:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738399744:12345-0@lo:400:kworker.0 Request processed in 52us (2667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672821.069310:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789672821.069325:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738400384:12345-0@lo:400:kworker.0 Request processed in 1191us (2926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672821.069332:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789672821.069346:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738399488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.069370:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789672821.069404:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789672821.069411:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738399488:12345-0@lo:400:kworker.0 Request processed in 70us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672821.069419:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738400256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.069485:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738400256:12345-0@lo:400:kworker.0 Request processed in 74us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672821.069491:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789672821.069503:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789672821.069509:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738400768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.069536:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738400768:12345-0@lo:400:kworker.0 Request processed in 28us (2720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672821.069541:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789672821.069570:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738400896 00000100:00100000:2.0:1789672821.069575:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738400896 00000100:00100000:2.0:1789672821.069608:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789672821.069615:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738400896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789672821.069628:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672821.069677:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738400896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (3221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672821.069683:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789672821.069783:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789672821.069794:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738400000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.069831:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738400000:12345-0@lo:400:kworker.0 Request processed in 40us (2209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672821.069838:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789672821.069856:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789672821.069877:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738400512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672821.069888:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789672821.069901:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738400128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672821.069952:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738400128:12345-0@lo:400:kworker.0 Request processed in 55us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672821.069961:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789672821.069986:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789672821.070007:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738400512:12345-0@lo:400:kworker.0 Request processed in 124us (2299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672821.070007:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738400640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.070029:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789672821.070064:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738400640:12345-0@lo:400:kworker.0 Request processed in 70us (2096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672821.070071:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789672821.070099:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738399616 00000100:00100000:1.0:1789672821.070103:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738399616 00000100:00080000:2.0:1789672821.070128:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789672821.070135:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789672821.070142:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789672821.070145:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672821.070146:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789672821.070159:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738399616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672821.070202:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738399616:12345-0@lo:400:kworker.0 Request processed in 48us (2392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672821.070219:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789672821.070269:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d869880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738399744:0@lo:400:kworker.0 00010000:00080000:2.0:1789672821.070293:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d868e00 x1876607738400256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672821.070304:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d868e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738400256:0@lo:400:kworker.0 00010000:00080000:2.0:1789672821.070315:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d868380 x1876607738400768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672821.070324:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738400768:0@lo:400:kworker.0 00010000:00080000:2.0:1789672821.070334:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8c8a80 x1876607738400896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672821.070349:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738400896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789672821.070365:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738399360:0@lo:400:kworker.0 00010000:00080000:2.0:1789672821.070377:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d86aa00 x1876607738400384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672821.070384:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738400384:0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.070459:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738399616:0@lo:400:kworker.0 00010000:00080000:2.0:1789672821.070497:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d869c00 x1876607738400128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672821.070505:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d869c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738400128:0@lo:400:kworker.0 00010000:00080000:2.0:1789672821.070516:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d86b100 x1876607738400640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672821.070524:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738400640:0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.070535:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738399488:0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.070545:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d869f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738400000:0@lo:400:kworker.0 00000100:00100000:2.0:1789672821.070554:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738400512:0@lo:400:kworker.0 00000100:00100000:0.0:1789672821.072887:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00010000:3.0:1789672821.956642:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672822.597779:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738401024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672822.597878:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672822.597984:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738401024 00000100:00100000:3.0:1789672822.597995:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738401024 00000100:00100000:3.0:1789672822.598054:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789672822.598064:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738401024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672822.598099:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672822.598150:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738401024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672822.598158:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1789672822.598209:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5ac000 x1876607738401024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672822.598232:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738401024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672822.598947:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738401152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789672822.598992:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672822.599082:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738401152 00000100:00100000:2.0:1789672822.599089:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738401152 00000100:00100000:2.0:1789672822.599138:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789672822.599148:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738401152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789672822.599166:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672822.599255:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738401152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672822.599263:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1789672822.600644:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d96dc00 x1876607738401152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672822.600700:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738401152:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789672822.979763:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672823.625866:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672823.626010:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738401280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672823.626160:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672823.626286:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738401280 00000100:00100000:0.0:1789672823.626296:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738401280 00000100:00100000:0.0:1789672823.626467:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789672823.626478:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738401280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789672823.626512:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789672823.626569:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738401280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672823.626576:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789672823.626645:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738401280:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789672824.004090:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672824.645074:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738401408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789672824.645165:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672824.645873:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738401408 00000100:00100000:0.0:1789672824.645885:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738401408 00000100:00100000:0.0:1789672824.645948:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789672824.645958:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738401408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789672824.646019:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789672824.646383:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738401408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 425us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672824.646392:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789672824.647170:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738401408:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789672825.027899:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672825.305484:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672825.305533:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672825.305556:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672825.305589:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714208384 00000100:00100000:3.0:1789672825.305600:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714208384 00000100:00100000:3.0:1789672825.306069:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714208256 00000100:00100000:3.0:1789672825.306075:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714208256 00000100:00100000:3.0:1789672825.306115:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 128 00000100:00100000:3.0:1789672825.306126:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2395:x1876607714208384:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672825.306204:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2395:x1876607714208384:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 80us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672825.306212:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 128 00000100:00100000:3.0:1789672825.306230:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 129 00000100:00100000:3.0:1789672825.306236:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2395:x1876607714208256:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672825.306262:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2395:x1876607714208256:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 26us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672825.306268:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 129 00000100:00080000:3.0:1789672825.306285:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789672825.306290:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789672825.309646:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714208128 00000100:00100000:1.0:1789672825.309754:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714208128 00000100:00100000:1.0:1789672825.309813:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 290 00000100:00100000:1.0:1789672825.309825:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2395:x1876607714208128:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672825.309901:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2395:x1876607714208128:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 78us (4429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672825.309923:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 290 00010000:00010000:2.0:1789672826.052062:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672826.183254:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738401664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672826.185409:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672826.185806:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789672826.185822:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738401536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789672826.185875:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672826.185935:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738401664 00000100:00100000:2.0:1789672826.185945:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738401664 00000100:00100000:2.0:1789672826.186002:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738401536 00000100:00100000:2.0:1789672826.186005:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738401536 00000100:00100000:2.0:1789672826.186026:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789672826.186035:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738401664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789672826.186070:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672826.186120:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738401664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672826.186127:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789672826.186159:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789672826.186166:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738401536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789672826.186176:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672826.186201:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738401536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672826.186208:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1789672826.186259:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7dac1880 x1876607738401536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672826.186280:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738401536:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789672826.186293:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7dac1f80 x1876607738401664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672826.186304:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738401664:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789672826.188122:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672826.194915:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738401792:0@lo:400:kworker.0 00000100:00100000:3.0:1789672826.195000:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672826.197907:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738401792 00000100:00100000:2.0:1789672826.197922:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738401792 00000100:00100000:2.0:1789672826.197980:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789672826.197991:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738401792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.199408:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738402176:0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.199471:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672826.199503:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738402688:0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.199527:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672826.199551:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789672826.199558:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738402048:0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.199582:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672826.199599:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738402560:0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.199617:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672826.199634:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876607738403072:0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.199653:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672826.199709:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738402176 00000100:00100000:0.0:1789672826.199716:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738402176 00000100:00100000:0.0:1789672826.199760:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738402560 00000100:00100000:0.0:1789672826.199764:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738402560 00000100:00100000:0.0:1789672826.199793:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738403072 00000100:00100000:0.0:1789672826.199795:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738403072 00000100:00100000:0.0:1789672826.199829:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789672826.199837:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738402176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.199888:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738402176:12345-0@lo:400:kworker.0 Request processed in 51us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672826.200136:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738401792:12345-0@lo:400:kworker.0 Request processed in 2145us (5135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672826.200148:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789672826.200759:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738401920:0@lo:400:kworker.0 00000100:00100000:2.0:1789672826.200800:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672826.200814:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738402432:0@lo:400:kworker.0 00000100:00100000:2.0:1789672826.200832:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672826.200841:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738402944:0@lo:400:kworker.0 00000100:00100000:2.0:1789672826.200856:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672826.200869:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789672826.200875:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738402304:0@lo:400:kworker.0 00000100:00100000:2.0:1789672826.200895:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672826.200917:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738402816:0@lo:400:kworker.0 00000100:00100000:2.0:1789672826.200938:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672826.200968:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738402688 00000100:00100000:2.0:1789672826.200973:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738402688 00000100:00100000:2.0:1789672826.201008:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738402816 00000100:00100000:2.0:1789672826.201011:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738402816 00000100:00100000:2.0:1789672826.201032:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789672826.201039:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738402688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672826.201080:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738402688:12345-0@lo:400:kworker.0 Request processed in 42us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672826.201096:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789672826.201110:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789672826.201115:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738402816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672826.201149:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738402816:12345-0@lo:400:kworker.0 Request processed in 32us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672826.201155:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1789672826.201193:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47906d80 x1876607738402816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672826.201210:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738402816:0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.203569:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789672826.203622:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738401920 00000100:00100000:0.0:1789672826.203631:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738401920 00000100:00100000:0.0:1789672826.203678:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738402432 00000100:00100000:0.0:1789672826.203681:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738402432 00000100:00100000:0.0:1789672826.203699:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738402944 00000100:00100000:0.0:1789672826.203702:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738402944 00000100:00100000:0.0:1789672826.203722:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789672826.203732:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738402560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.203825:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738402560:12345-0@lo:400:kworker.0 Request processed in 95us (4206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672826.203831:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789672826.203845:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789672826.203852:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876607738403072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.203882:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876607738403072:12345-0@lo:400:kworker.0 Request processed in 30us (4228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672826.203999:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789672826.204015:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789672826.204021:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738401920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.204071:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738401920:12345-0@lo:400:kworker.0 Request processed in 50us (3271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672826.204077:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789672826.204089:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789672826.204095:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738402432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.204120:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738402432:12345-0@lo:400:kworker.0 Request processed in 26us (3287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672826.204121:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738401920:0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.204126:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789672826.204134:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738402432:0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.204135:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789672826.204160:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738402944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.204206:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738402944:12345-0@lo:400:kworker.0 Request processed in 57us (3348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672826.204212:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789672826.204226:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738402944:0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.204241:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738402048 00000100:00100000:0.0:1789672826.204245:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738402048 00000100:00100000:0.0:1789672826.204653:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738402304 00000100:00100000:0.0:1789672826.204683:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738402304 00000100:00100000:2.0:1789672826.204742:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789672826.204751:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738402048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672826.204796:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738402048:12345-0@lo:400:kworker.0 Request processed in 47us (5212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672826.204803:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789672826.204817:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789672826.204823:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738402304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672826.204859:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738402304:12345-0@lo:400:kworker.0 Request processed in 37us (3963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672826.204865:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789672826.204907:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738402304:0@lo:400:kworker.0 00000100:00100000:3.0:1789672826.208887:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738401792:0@lo:400:kworker.0 00000100:00080000:3.0:1789672826.209008:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789672826.209015:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789672826.209018:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789672826.209850:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738402048:0@lo:400:kworker.0 00010000:00080000:0.0:1789672826.209872:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47905c00 x1876607738402560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672826.209883:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738402560:0@lo:400:kworker.0 00010000:00080000:0.0:1789672826.209909:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47907480 x1876607738403072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672826.209918:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876607738403072:0@lo:400:kworker.0 00000100:00100000:0.0:1789672826.209932:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738402176:0@lo:400:kworker.0 00010000:00080000:0.0:1789672826.209944:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47905180 x1876607738402688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672826.209953:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738402688:0@lo:400:kworker.0 00010000:00010000:1.0:1789672827.076114:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672827.716745:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738403200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672827.716822:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672827.716864:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738403200 00000100:00100000:0.0:1789672827.716873:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738403200 00000100:00100000:0.0:1789672827.716923:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789672827.716932:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738403200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672827.716962:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672827.717022:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738403200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (198us total) trans 0 rc 0/0 00010000:00080000:3.0:1789672827.717075:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5adf80 x1876607738403200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672827.717093:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738403200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672827.719729:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672827.719750:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738403328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789672827.719821:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672827.721453:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789672827.721496:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738403328 00000100:00100000:0.0:1789672827.721506:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738403328 00000100:00100000:0.0:1789672827.721547:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789672827.721556:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738403328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789672827.721583:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672827.721680:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738403328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (1859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672827.721688:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1789672827.721738:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7dac0000 x1876607738403328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672827.721761:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738403328:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789672828.101201:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672828.742471:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738403456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672828.742622:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672828.742731:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738403456 00000100:00100000:1.0:1789672828.742741:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738403456 00000100:00100000:1.0:1789672828.742792:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789672828.742801:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738403456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789672828.742838:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789672828.742885:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738403456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672828.742892:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789672828.742942:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738403456:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789672829.124546:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672829.766783:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672829.766805:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738403584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789672829.766872:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672829.766939:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738403584 00000100:00100000:3.0:1789672829.766947:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738403584 00000100:00100000:3.0:1789672829.766991:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789672829.766998:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738403584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789672829.767033:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789672829.767072:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738403584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672829.767078:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789672829.767119:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738403584:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789672830.148558:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672830.420212:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672830.420644:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672830.420699:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672830.420726:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714208768 00000100:00100000:0.0:1789672830.420735:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714208768 00000100:00100000:0.0:1789672830.420791:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714208640 00000100:00100000:0.0:1789672830.420795:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714208640 00000100:00100000:0.0:1789672830.420963:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 136 00000100:00100000:0.0:1789672830.420976:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714208768:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672830.421059:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714208768:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 87us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672830.421067:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 136 00000100:00100000:0.0:1789672830.421097:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 137 00000100:00100000:0.0:1789672830.421103:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2397:x1876607714208640:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672830.421130:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2397:x1876607714208640:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 28us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672830.421135:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 137 00000100:00080000:0.0:1789672830.421153:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672830.421157:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789672830.427436:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714208512 00000100:00100000:1.0:1789672830.427521:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714208512 00000100:00100000:1.0:1789672830.427650:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 292 00000100:00100000:1.0:1789672830.427751:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2397:x1876607714208512:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672830.427999:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2397:x1876607714208512:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 252us (7795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672830.428007:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 292 00010000:00010000:1.0:1789672831.172053:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672831.300042:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738403712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672831.300159:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672831.300550:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738403712 00000100:00100000:2.0:1789672831.300567:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738403712 00000100:00100000:2.0:1789672831.300712:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789672831.300732:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738403712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789672831.300778:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672831.300863:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738403712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672831.300872:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1789672831.300933:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8c9880 x1876607738403712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672831.300960:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738403712:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789672831.302769:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789672831.303404:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738404096:0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.303507:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672831.303569:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738404608:0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.303594:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672831.303621:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738405120:0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.303644:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672831.303707:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789672831.303714:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738404224:0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.303757:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672831.303779:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738404736:0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.303804:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672831.303820:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738405248:0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.303841:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672831.303875:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738404096 00000100:00100000:0.0:1789672831.303884:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738404096 00000100:00100000:0.0:1789672831.303929:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738404608 00000100:00100000:0.0:1789672831.303933:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738404608 00000100:00100000:0.0:1789672831.303958:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738405120 00000100:00100000:0.0:1789672831.303961:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738405120 00000100:00100000:0.0:1789672831.303985:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738404736 00000100:00100000:0.0:1789672831.303988:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738404736 00000100:00100000:0.0:1789672831.304001:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738405248 00000100:00100000:0.0:1789672831.304003:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738405248 00000100:00100000:0.0:1789672831.304020:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789672831.304029:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738404096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.304089:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738404096:12345-0@lo:400:kworker.0 Request processed in 60us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672831.304096:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789672831.304115:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789672831.304121:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738404608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.304285:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738404608:12345-0@lo:400:kworker.0 Request processed in 163us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672831.304303:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789672831.304316:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789672831.304322:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738405120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.304351:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738405120:12345-0@lo:400:kworker.0 Request processed in 29us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672831.304358:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789672831.304369:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789672831.304375:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738404736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.304401:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738404736:12345-0@lo:400:kworker.0 Request processed in 26us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672831.304407:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789672831.304419:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789672831.304426:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738405248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.304468:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738405248:12345-0@lo:400:kworker.0 Request processed in 43us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672831.304475:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789672831.304503:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738404224 00000100:00100000:0.0:1789672831.304508:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738404224 00000100:00100000:0.0:1789672831.304533:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789672831.304540:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738404224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.304573:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738404224:12345-0@lo:400:kworker.0 Request processed in 34us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672831.304580:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1789672831.304605:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789672831.304609:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672831.304642:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738404224:0@lo:400:kworker.0 00010000:00080000:0.0:1789672831.304685:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47938e00 x1876607738404736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672831.304697:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738404736:0@lo:400:kworker.0 00010000:00080000:0.0:1789672831.304707:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5a9c00 x1876607738405248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672831.304715:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738405248:0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.304725:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738404096:0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.304734:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738404608:0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.304743:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738405120:0@lo:400:kworker.0 00000100:00100000:1.0:1789672831.304931:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738403840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789672831.304978:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672831.305020:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738404352:0@lo:400:kworker.0 00000100:00100000:1.0:1789672831.305044:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672831.305065:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738404864:0@lo:400:kworker.0 00000100:00100000:1.0:1789672831.305089:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672831.305106:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738405376:0@lo:400:kworker.0 00000100:00100000:1.0:1789672831.305124:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672831.305155:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789672831.305161:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d96dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738403968:0@lo:400:kworker.0 00000100:00100000:1.0:1789672831.305191:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672831.305222:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738404480:0@lo:400:kworker.0 00000100:00100000:1.0:1789672831.305246:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672831.305264:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738404992:0@lo:400:kworker.0 00000100:00100000:1.0:1789672831.305285:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672831.305585:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738403840 00000100:00100000:3.0:1789672831.305593:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738403840 00000100:00100000:3.0:1789672831.305653:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789672831.305696:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738403840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789672831.305719:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672831.305770:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738403840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672831.305777:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789672831.305800:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738404480 00000100:00100000:3.0:1789672831.305810:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738404480 00000100:00100000:3.0:1789672831.305837:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789672831.305843:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738404480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672831.305876:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d869c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738404480:12345-0@lo:400:kworker.0 Request processed in 34us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672831.305883:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789672831.305916:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738404480:0@lo:400:kworker.0 00010000:00080000:3.0:1789672831.305930:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb48075f80 x1876607738403840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672831.305947:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738403840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789672831.306199:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738404864 00000100:00100000:2.0:1789672831.306215:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738404864 00000100:00100000:2.0:1789672831.306260:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738405376 00000100:00100000:2.0:1789672831.306264:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738405376 00000100:00100000:2.0:1789672831.306276:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738404992 00000100:00100000:2.0:1789672831.306279:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738404992 00000100:00100000:2.0:1789672831.306304:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789672831.306312:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738404864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672831.306360:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738404864:12345-0@lo:400:kworker.0 Request processed in 49us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672831.306367:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789672831.306380:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789672831.306399:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738405376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672831.306429:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738405376:12345-0@lo:400:kworker.0 Request processed in 32us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672831.306435:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789672831.306446:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789672831.306452:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738404992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672831.306479:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738404992:12345-0@lo:400:kworker.0 Request processed in 27us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672831.306485:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789672831.306510:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738403968 00000100:00100000:2.0:1789672831.306514:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738403968 00000100:00100000:2.0:1789672831.306540:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789672831.306547:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738403968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672831.306581:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738403968:12345-0@lo:400:kworker.0 Request processed in 36us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672831.306587:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789672831.306642:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d96dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738403968:0@lo:400:kworker.0 00010000:00080000:2.0:1789672831.306653:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47939500 x1876607738404992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672831.306695:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738404992:0@lo:400:kworker.0 00010000:00080000:2.0:1789672831.306707:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb4793b480 x1876607738404864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672831.306714:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738404864:0@lo:400:kworker.0 00010000:00080000:2.0:1789672831.306723:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5a8e00 x1876607738405376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672831.306738:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738405376:0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.310164:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738404352 00000100:00100000:0.0:1789672831.310209:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738404352 00000100:00100000:0.0:1789672831.310314:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789672831.310326:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738404352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672831.310448:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d869f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738404352:12345-0@lo:400:kworker.0 Request processed in 125us (5403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672831.310454:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1789672831.310826:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672831.310833:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789672831.312469:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738404352:0@lo:400:kworker.0 00010000:00010000:3.0:1789672832.195999:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672832.835932:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789672832.835964:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738405504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789672832.836059:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672832.836145:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738405504 00000100:00100000:2.0:1789672832.836154:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738405504 00000100:00100000:3.0:1789672832.836629:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789672832.836645:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738405504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789672832.836710:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672832.836780:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738405504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672832.836788:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789672832.836851:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672832.836862:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738405632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672832.836899:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672832.837899:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738405632 00000100:00100000:2.0:1789672832.837912:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738405632 00000100:00100000:2.0:1789672832.837974:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789672832.837985:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738405632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789672832.838008:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672832.838080:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738405632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672832.838087:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1789672832.838536:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5aaa00 x1876607738405632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672832.838562:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738405632:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789672832.838606:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8c9880 x1876607738405504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672832.838650:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738405504:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1789672833.156270:0:11991:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 15:20:30 (1789672830) === 00010000:00010000:1.0:1789672833.220188:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672833.555820:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672833.556036:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714208896 00000100:00100000:2.0:1789672833.556053:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714208896 00000100:00100000:2.0:1789672833.556132:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 294 00000100:00100000:2.0:1789672833.556145:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:8741:x1876607714208896:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789672833.556166:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672833.556200:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8a0c00/0x6c78c4f8c9965113 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24f16 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672833.556239:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8a0c00/0x6c78c4f8c9965113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f16 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672833.556285:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8a0c00/0x6c78c4f8c9965113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f16 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672833.556297:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a0c00, rc 0) 00000100:00100000:2.0:1789672833.556382:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:8741:x1876607714208896:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 240us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672833.556400:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 294 00000100:00100000:1.0:1789672833.565485:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672833.565724:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714209024 00000100:00100000:2.0:1789672833.565739:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714209024 00000100:00100000:2.0:1789672833.565819:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 295 00000100:00100000:2.0:1789672833.565832:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:8741:x1876607714209024:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789672833.566086:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:8741:x1876607714209024:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 256us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672833.566095:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 295 00000100:00100000:3.0:1789672833.570520:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672833.570692:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714209152 00000100:00100000:0.0:1789672833.570706:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714209152 00000100:00100000:0.0:1789672833.570780:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 296 00000100:00100000:0.0:1789672833.570793:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:8741:x1876607714209152:12345-192.168.201.50@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789672833.571054:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:8741:x1876607714209152:12345-192.168.201.50@tcp:503:mount.lustre.0 Request processed in 261us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672833.571063:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 296 00000100:00100000:0.0:1789672833.584527:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672833.585527:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714209280 00000100:00100000:1.0:1789672833.585547:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714209280 00000100:00100000:1.0:1789672833.585627:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 297 00000100:00100000:1.0:1789672833.585639:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:8745:x1876607714209280:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789672833.585921:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:8745:x1876607714209280:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 283us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672833.585929:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 297 00000100:00100000:0.0:1789672833.612544:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672833.612680:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714209408 00000100:00100000:2.0:1789672833.612696:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714209408 00000100:00100000:2.0:1789672833.612769:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 298 00000100:00100000:2.0:1789672833.612782:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:8745:x1876607714209408:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789672833.613059:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:8745:x1876607714209408:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 279us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672833.613068:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 298 00000100:00100000:3.0:1789672833.620989:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672833.623161:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714209536 00000100:00100000:0.0:1789672833.623183:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714209536 00000100:00100000:0.0:1789672833.623310:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 299 00000100:00100000:0.0:1789672833.623324:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:8745:x1876607714209536:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789672833.623867:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:8745:x1876607714209536:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 540us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672833.623879:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 299 00000100:00100000:1.0:1789672833.627019:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672833.627379:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714209664 00000100:00100000:2.0:1789672833.627462:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714209664 00000100:00100000:2.0:1789672833.627577:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 300 00000100:00100000:2.0:1789672833.627590:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:8741:x1876607714209664:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789672833.627634:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672833.627694:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8a1800/0x6c78c4f8c996511a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24f47 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672833.627732:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8a1800/0x6c78c4f8c996511a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f47 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672833.627746:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8a1800/0x6c78c4f8c996511a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f47 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672833.627756:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a1800, rc 0) 00000100:00100000:2.0:1789672833.627832:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:8741:x1876607714209664:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 244us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672833.627840:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 300 00000100:00100000:2.0:1789672833.630790:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672833.630951:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714209792 00000100:00100000:0.0:1789672833.630965:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714209792 00000100:00100000:0.0:1789672833.631121:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 301 00000100:00100000:0.0:1789672833.631133:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:8741:x1876607714209792:12345-192.168.201.50@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789672833.631185:0:6507:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789672833.631484:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789672833.631490:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789672833.631494:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789672833.631496:0:6507:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789672833.631499:0:6507:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789672833.633804:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:8741:x1876607714209792:12345-192.168.201.50@tcp:256:mount.lustre.0 Request processed in 2655us (3013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672833.633823:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 301 00000100:00100000:1.0:1789672833.636797:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672833.636923:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714209920 00000100:00100000:2.0:1789672833.636938:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714209920 00000100:00100000:2.0:1789672833.637046:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 302 00000100:00100000:2.0:1789672833.637060:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:8741:x1876607714209920:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789672833.637082:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672833.637106:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9965121 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24f4e expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672833.637148:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9965121 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f4e expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672833.637161:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9965121 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f4e expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672833.637211:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a0000, rc 0) 00000100:00100000:2.0:1789672833.637302:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:8741:x1876607714209920:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 245us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672833.637310:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 302 00000100:00100000:0.0:1789672833.639533:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672833.639621:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714210048 00000100:00100000:1.0:1789672833.639633:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714210048 00000100:00100000:1.0:1789672833.639719:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 303 00000100:00100000:1.0:1789672833.639731:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:8741:x1876607714210048:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789672833.639938:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:8741:x1876607714210048:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 209us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672833.639948:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 303 00000100:00100000:3.0:1789672833.642124:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672833.642478:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714210176 00000100:00100000:1.0:1789672833.642490:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714210176 00000100:00100000:1.0:1789672833.642603:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 304 00000100:00100000:1.0:1789672833.642616:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:8741:x1876607714210176:12345-192.168.201.50@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789672833.642855:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:8741:x1876607714210176:12345-192.168.201.50@tcp:503:mount.lustre.0 Request processed in 240us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672833.642876:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 304 00000100:00100000:3.0:1789672833.646767:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672833.646928:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714210304 00000100:00100000:2.0:1789672833.646943:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714210304 00000100:00100000:2.0:1789672833.647067:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 305 00000100:00100000:2.0:1789672833.647081:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:8748:x1876607714210304:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789672833.647506:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:8748:x1876607714210304:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 427us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672833.647517:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 305 00000100:00100000:1.0:1789672833.652797:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672833.659953:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714210432 00000100:00100000:0.0:1789672833.659976:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714210432 00000100:00100000:0.0:1789672833.660054:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 306 00000100:00100000:0.0:1789672833.660067:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:8748:x1876607714210432:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789672833.664751:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:8748:x1876607714210432:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 4670us (11951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672833.664772:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 306 00000100:00100000:1.0:1789672833.671554:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672833.671606:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672833.671647:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672833.671719:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672833.671909:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714210560 00000100:00100000:3.0:1789672833.671926:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714210560 00000100:00100000:3.0:1789672833.671983:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714210816 00000100:00100000:3.0:1789672833.671987:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714210816 00000100:00100000:3.0:1789672833.671996:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714211200 00000100:00100000:3.0:1789672833.671999:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714211200 00000100:00100000:3.0:1789672833.672041:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714211328 00000100:00100000:3.0:1789672833.672044:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714211328 00000100:00100000:3.0:1789672833.672066:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 144 00000100:00100000:3.0:1789672833.672079:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714211200:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672833.672178:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714211200:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 102us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672833.672186:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 144 00000100:00100000:3.0:1789672833.672213:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 145 00000100:00100000:3.0:1789672833.672220:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714211328:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672833.672259:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714211328:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 28us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672833.672266:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 145 00000100:00100000:3.0:1789672833.672278:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:3.0:1789672833.672283:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1876607714210560:12345-192.168.201.50@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789672833.672334:0:9524:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 33c1cd4d-7765-4bf5-8421-437f0a05573b@192.168.201.50@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:3.0:1789672833.672382:0:9524:0:(genops.c:1384:class_connect()) connect: client 33c1cd4d-7765-4bf5-8421-437f0a05573b, cookie 0x6c78c4f8c9965128 00000004:00100000:3.0:1789672833.672417:0:9524:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789672833.672577:0:9524:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f57b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789672833.672611:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:2394:x1876607714210560:12345-192.168.201.50@tcp:38:mount.lustre.0 Request processed in 326us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672833.672619:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:3.0:1789672833.672632:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:3.0:1789672833.672637:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1876607714210816:12345-192.168.201.50@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789672833.672654:0:9524:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 33c1cd4d-7765-4bf5-8421-437f0a05573b@192.168.201.50@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:3.0:1789672833.672717:0:9524:0:(genops.c:1384:class_connect()) connect: client 33c1cd4d-7765-4bf5-8421-437f0a05573b, cookie 0x6c78c4f8c996512f 00000004:00100000:3.0:1789672833.672731:0:9524:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789672833.672798:0:9524:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f57c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789672833.672824:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:2394:x1876607714210816:12345-192.168.201.50@tcp:38:mount.lustre.0 Request processed in 185us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672833.672831:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00080000:1.0:1789672833.673054:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789672833.673060:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672833.676132:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672833.676880:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672833.677429:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714210688 00000100:00100000:2.0:1789672833.677443:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714210688 00000100:00100000:2.0:1789672833.677539:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714210944 00000100:00100000:2.0:1789672833.677544:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714210944 00000100:00100000:2.0:1789672833.677574:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:2.0:1789672833.677586:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:0:x1876607714210688:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789672833.677634:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789672833.677780:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:0:x1876607714210688:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 194us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672833.677788:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:2.0:1789672833.677811:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:2.0:1789672833.677819:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:0:x1876607714210944:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789672833.677864:0:6513:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789672833.677907:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:0:x1876607714210944:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 89us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672833.677914:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00080000:1.0:1789672833.678034:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789672833.678039:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672833.680477:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672833.680645:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714211072 00000100:00100000:0.0:1789672833.680760:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714211072 00000100:00100000:2.0:1789672833.680902:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:2.0:1789672833.680914:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:8741:x1876607714211072:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789672833.680961:0:11081:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789672833.681086:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:8741:x1876607714211072:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 173us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672833.681095:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:1.0:1789672833.683350:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672833.683452:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714211456 00000100:00100000:2.0:1789672833.683466:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714211456 00000100:00100000:2.0:1789672833.683543:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:2.0:1789672833.683555:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:8741:x1876607714211456:12345-192.168.201.50@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789672833.683919:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:8741:x1876607714211456:12345-192.168.201.50@tcp:40:mount.lustre.0 Request processed in 364us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672833.683929:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:1.0:1789672833.686821:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672833.686864:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672833.686978:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672833.687047:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714211840 00000100:00100000:0.0:1789672833.687061:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714211840 00000100:00100000:0.0:1789672833.687124:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:0.0:1789672833.687135:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:8741:x1876607714211840:12345-192.168.201.50@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789672833.687242:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:8741:x1876607714211840:12345-192.168.201.50@tcp:900:mount.lustre.0 Request processed in 108us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672833.687261:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:1.0:1789672833.689459:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672833.689583:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714211968 00000100:00100000:0.0:1789672833.689594:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714211968 00000100:00100000:0.0:1789672833.689676:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:0.0:1789672833.689689:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:8741:x1876607714211968:12345-192.168.201.50@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789672833.689812:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789672833.689915:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:8741:x1876607714211968:12345-192.168.201.50@tcp:33:mount.lustre.0 Request processed in 229us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672833.689923:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:2.0:1789672833.693893:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714211584 00000100:00100000:2.0:1789672833.693917:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714211584 00000100:00100000:2.0:1789672833.693998:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714211712 00000100:00100000:2.0:1789672833.694002:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714211712 00000100:00100000:2.0:1789672833.694044:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:2.0:1789672833.694056:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1876607714211584:12345-192.168.201.50@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789672833.694109:0:8494:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 33c1cd4d-7765-4bf5-8421-437f0a05573b@192.168.201.50@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:2.0:1789672833.694174:0:8494:0:(genops.c:1384:class_connect()) connect: client 33c1cd4d-7765-4bf5-8421-437f0a05573b, cookie 0x6c78c4f8c9965136 00002000:00100000:2.0:1789672833.694190:0:8494:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 33c1cd4d-7765-4bf5-8421-437f0a05573b/ffff8cfb47961800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789672833.694206:0:8494:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789672833.694335:0:8494:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789672833.694382:0:8494:0:(import.c:65:import_set_state_nolock()) ffff8cfb47964000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789672833.694509:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:0.0:1789672833.694518:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1876607714211712:12345-192.168.201.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789672833.694542:0:8429:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 33c1cd4d-7765-4bf5-8421-437f0a05573b@192.168.201.50@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:0.0:1789672833.694566:0:8429:0:(genops.c:1384:class_connect()) connect: client 33c1cd4d-7765-4bf5-8421-437f0a05573b, cookie 0x6c78c4f8c996513d 00002000:00100000:0.0:1789672833.694572:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 33c1cd4d-7765-4bf5-8421-437f0a05573b/ffff8cfb47a6c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789672833.694588:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789672833.694638:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789672833.694653:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8cfb47a69800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789672833.694771:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:2394:x1876607714211712:12345-192.168.201.50@tcp:8:mount.lustre.0 Request processed in 251us (7790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672833.694780:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:2.0:1789672833.694985:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:2394:x1876607714211584:12345-192.168.201.50@tcp:8:mount.lustre.0 Request processed in 930us (8119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672833.694993:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:0.0:1789672833.860147:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672833.860182:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738405760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789672833.860305:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672833.860789:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738405760 00000100:00100000:1.0:1789672833.860803:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738405760 00000100:00100000:1.0:1789672833.860881:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789672833.860894:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738405760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789672833.860935:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789672833.861001:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738405760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672833.861009:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789672833.861149:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738405760:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789672834.250654:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672834.888819:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672834.888854:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738405888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789672834.888960:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672834.889097:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738405888 00000100:00100000:1.0:1789672834.889109:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738405888 00000100:00100000:1.0:1789672834.889184:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789672834.889196:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738405888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789672834.889281:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789672834.889347:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738405888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 154us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672834.889355:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789672834.889495:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738405888:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789672835.270697:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672836.292897:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672836.421920:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738406144:0@lo:400:kworker.0 00000100:00100000:1.0:1789672836.422019:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672836.422087:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738406656:0@lo:400:kworker.0 00000100:00100000:1.0:1789672836.422110:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672836.422140:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738407168:0@lo:400:kworker.0 00000100:00100000:1.0:1789672836.422162:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672836.422189:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789672836.422196:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738406272:0@lo:400:kworker.0 00000100:00100000:1.0:1789672836.422235:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672836.422252:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738406784:0@lo:400:kworker.0 00000100:00100000:1.0:1789672836.422273:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672836.422286:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738407296:0@lo:400:kworker.0 00000100:00100000:1.0:1789672836.422304:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672836.422356:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738406144 00000100:00100000:1.0:1789672836.422366:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738406144 00000100:00100000:1.0:1789672836.422414:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738406656 00000100:00100000:1.0:1789672836.422417:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738406656 00000100:00100000:1.0:1789672836.422442:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738407168 00000100:00100000:1.0:1789672836.422444:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738407168 00000100:00100000:1.0:1789672836.422457:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738406784 00000100:00100000:1.0:1789672836.422460:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738406784 00000100:00100000:1.0:1789672836.422474:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738407296 00000100:00100000:1.0:1789672836.422495:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738407296 00000100:00100000:1.0:1789672836.422518:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789672836.422527:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738406144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672836.422589:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738406144:12345-0@lo:400:kworker.0 Request processed in 63us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672836.422597:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789672836.422616:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789672836.422622:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738406656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672836.422648:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738406656:12345-0@lo:400:kworker.0 Request processed in 27us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672836.422654:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789672836.422703:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789672836.422709:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738407168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672836.422737:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738407168:12345-0@lo:400:kworker.0 Request processed in 28us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672836.422743:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789672836.422754:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789672836.422760:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738406784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672836.422784:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738406784:12345-0@lo:400:kworker.0 Request processed in 24us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672836.422790:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789672836.422800:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789672836.422806:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738407296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672836.422828:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738407296:12345-0@lo:400:kworker.0 Request processed in 23us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672836.422843:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1789672836.422870:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789672836.422875:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789672836.422905:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462dd880 x1876607738406784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672836.422923:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738406784:0@lo:400:kworker.0 00010000:00080000:1.0:1789672836.422933:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462ded80 x1876607738407296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672836.422942:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738407296:0@lo:400:kworker.0 00000100:00100000:1.0:1789672836.422951:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738406144:0@lo:400:kworker.0 00000100:00100000:1.0:1789672836.422960:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738406656:0@lo:400:kworker.0 00000100:00100000:1.0:1789672836.422969:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738407168:0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.423147:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738406400:0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.423180:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672836.423222:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738406912:0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.423249:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672836.423269:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738407424:0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.423289:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672836.423314:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789672836.423321:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738406016:0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.423371:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672836.423394:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738406528:0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.423418:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672836.423436:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738407040:0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.423456:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672836.423476:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738407552:0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.423497:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672836.423528:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738406400 00000100:00100000:3.0:1789672836.423533:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738406400 00000100:00100000:3.0:1789672836.423565:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789672836.423571:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738406400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.423608:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738406400:12345-0@lo:400:kworker.0 Request processed in 37us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672836.423614:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789672836.423633:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738406272 00000100:00100000:3.0:1789672836.423636:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738406272 00000100:00100000:3.0:1789672836.423687:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738406528 00000100:00100000:3.0:1789672836.423690:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738406528 00000100:00100000:3.0:1789672836.423706:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789672836.423712:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738406272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.423755:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738406272:12345-0@lo:400:kworker.0 Request processed in 42us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672836.423762:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789672836.423774:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789672836.423779:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738406528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.423804:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738406528:12345-0@lo:400:kworker.0 Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672836.423817:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789672836.423839:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738406912 00000100:00100000:3.0:1789672836.423843:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738406912 00000100:00100000:3.0:1789672836.423872:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738407424 00000100:00100000:3.0:1789672836.423874:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738407424 00000100:00100000:3.0:1789672836.423886:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738407040 00000100:00100000:3.0:1789672836.423889:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738407040 00000100:00100000:3.0:1789672836.423902:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738407552 00000100:00100000:3.0:1789672836.423904:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738407552 00000100:00100000:3.0:1789672836.423916:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789672836.423922:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738406912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.423953:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738406912:12345-0@lo:400:kworker.0 Request processed in 31us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672836.423959:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789672836.423968:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789672836.423974:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738407424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.423998:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738407424:12345-0@lo:400:kworker.0 Request processed in 24us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672836.424003:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789672836.424013:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789672836.424018:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738407040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.424041:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738407040:12345-0@lo:400:kworker.0 Request processed in 23us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672836.424047:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789672836.424056:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789672836.424062:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738407552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.424095:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738407552:12345-0@lo:400:kworker.0 Request processed in 33us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672836.424101:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789672836.424125:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738406016 00000100:00100000:3.0:1789672836.424129:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738406016 00000100:00100000:3.0:1789672836.424157:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1789672836.424164:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738406016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.424196:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738406016:12345-0@lo:400:kworker.0 Request processed in 33us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672836.424212:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:3.0:1789672836.424261:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789672836.424264:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672836.424288:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738406016:0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.424302:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738406528:0@lo:400:kworker.0 00010000:00080000:3.0:1789672836.424312:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462ddc00 x1876607738407040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672836.424323:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738407040:0@lo:400:kworker.0 00010000:00080000:3.0:1789672836.424332:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d93ed80 x1876607738407552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672836.424341:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738407552:0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.424352:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738406400:0@lo:400:kworker.0 00010000:00080000:3.0:1789672836.424362:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462dc700 x1876607738406912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672836.424383:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738406912:0@lo:400:kworker.0 00010000:00080000:3.0:1789672836.424395:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d93c000 x1876607738407424/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672836.424404:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738407424:0@lo:400:kworker.0 00000100:00100000:3.0:1789672836.424445:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738406272:0@lo:400:kworker.0 00000100:00100000:0.0:1789672836.424779:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672836.424791:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738407680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789672836.424838:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672836.424874:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738407680 00000100:00100000:0.0:1789672836.424879:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738407680 00000100:00100000:0.0:1789672836.424911:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789672836.424919:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81a39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738407680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789672836.424947:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672836.424986:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81a39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738407680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672836.424993:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1789672836.425223:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d86f800 x1876607738407680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672836.425240:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738407680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789672836.425754:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672836.425767:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738407808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672836.425811:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672836.425972:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738407808 00000100:00100000:3.0:1789672836.425978:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738407808 00000100:00100000:3.0:1789672836.426021:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789672836.426031:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738407808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789672836.426048:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672836.426094:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738407808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672836.426102:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1789672836.426272:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5a9500 x1876607738407808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672836.426288:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738407808:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789672837.323935:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672837.956819:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738407936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672837.956927:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672837.957030:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672837.957038:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738408064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789672837.957064:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672837.957304:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738407936 00000100:00100000:3.0:1789672837.957323:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738407936 00000100:00100000:3.0:1789672837.957386:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738408064 00000100:00100000:3.0:1789672837.957390:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738408064 00000100:00100000:3.0:1789672837.957410:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789672837.957421:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738407936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672837.957460:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672837.957532:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738407936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672837.957539:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789672837.957559:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789672837.957566:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738408064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789672837.957596:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672837.957625:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738408064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672837.957631:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1789672837.957793:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8cb100 x1876607738408064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672837.957819:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738408064:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789672837.957832:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5ab480 x1876607738407936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672837.957845:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738407936:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789672838.340064:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789672838.985731:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 33c1cd4d-7765-4bf5-8421-437f0a05573b 00000100:00100000:3.0:1789672838.994766:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672838.994798:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738408192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789672838.994889:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672838.994966:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738408192 00000100:00100000:3.0:1789672838.994976:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738408192 00000001:00100000:2.0:1789672838.995523:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 33c1cd4d-7765-4bf5-8421-437f0a05573b 00000100:00100000:3.0:1789672838.996597:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789672838.996613:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738408192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789672838.996675:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789672838.996755:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738408192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 147us (1867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672838.996762:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789672838.998308:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738408192:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1789672838.999329:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 33c1cd4d-7765-4bf5-8421-437f0a05573b 00000001:00100000:0.0:1789672839.006738:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 33c1cd4d-7765-4bf5-8421-437f0a05573b 00000100:00100000:1.0:1789672839.128587:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672839.128882:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672839.128928:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672839.128963:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672839.129014:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672839.129037:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672839.129065:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672839.129307:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714212352 00000100:00100000:0.0:1789672839.129322:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714212352 00000100:00100000:0.0:1789672839.129422:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714212608 00000100:00100000:0.0:1789672839.129425:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714212608 00000100:00100000:0.0:1789672839.129439:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714212224 00000100:00100000:0.0:1789672839.129441:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714212224 00000100:00100000:0.0:1789672839.129455:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714212480 00000100:00100000:0.0:1789672839.129457:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714212480 00000100:00100000:0.0:1789672839.129475:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 152 00000100:00100000:0.0:1789672839.129495:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714212352:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672839.129595:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714212352:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 102us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672839.129605:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 152 00000100:00100000:0.0:1789672839.129625:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 153 00000100:00100000:0.0:1789672839.129632:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714212608:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672839.129682:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714212608:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 27us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672839.129690:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 153 00000100:00100000:0.0:1789672839.129701:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 154 00000100:00100000:0.0:1789672839.129708:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714212224:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672839.129737:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714212224:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 30us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672839.129743:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 154 00000100:00100000:0.0:1789672839.129754:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 155 00000100:00100000:0.0:1789672839.129760:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714212480:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672839.129783:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714212480:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 23us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672839.129789:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 155 00000100:00100000:0.0:1789672839.130000:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714212864 00000100:00100000:0.0:1789672839.130006:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714212864 00000100:00100000:0.0:1789672839.130039:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714212736 00000100:00100000:0.0:1789672839.130042:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714212736 00000100:00100000:0.0:1789672839.130068:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:0.0:1789672839.130084:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714212864:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672839.130132:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714212864:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 48us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672839.130138:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:0.0:1789672839.130163:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:0.0:1789672839.130170:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714212736:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672839.130194:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714212736:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672839.130199:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00080000:1.0:1789672839.130757:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672839.130766:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789672839.130769:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789672839.130773:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789672839.131594:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714212096 00000100:00100000:3.0:1789672839.131608:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714212096 00000100:00100000:2.0:1789672839.131795:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 308 00000100:00100000:2.0:1789672839.131822:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2396:x1876607714212096:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672839.131933:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2396:x1876607714212096:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 113us (3365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672839.131940:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 308 00010000:00010000:2.0:1789672839.372159:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789672839.391241:0:12184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1789672840.005051:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672840.005087:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738408320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789672840.005202:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672840.005353:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738408320 00000100:00100000:3.0:1789672840.005364:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738408320 00000100:00100000:3.0:1789672840.005427:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789672840.005437:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738408320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789672840.005484:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789672840.005539:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738408320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672840.005568:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789672840.008012:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738408320:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789672840.387870:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672841.411880:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672841.540753:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738408576:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.540875:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672841.540956:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738409088:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.540980:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672841.541007:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738409600:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.541043:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672841.541078:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789672841.541084:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738408448:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.541128:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672841.541152:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738408960:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.541179:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672841.541197:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738409472:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.541220:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672841.541548:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738409984:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.541598:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672841.541641:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738408704:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.541714:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672841.541736:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738409216:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.541758:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672841.541778:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738409728:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.541800:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672841.541833:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789672841.541840:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738408832:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.541866:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672841.541877:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738409344:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.541898:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672841.541916:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738409856:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.541936:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672841.541976:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738408576 00000100:00100000:1.0:1789672841.541986:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738408576 00000100:00100000:1.0:1789672841.542052:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738409088 00000100:00100000:1.0:1789672841.542056:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738409088 00000100:00100000:1.0:1789672841.542087:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738409600 00000100:00100000:1.0:1789672841.542091:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738409600 00000100:00100000:1.0:1789672841.542114:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738409216 00000100:00100000:1.0:1789672841.542117:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738409216 00000100:00100000:1.0:1789672841.542134:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738409728 00000100:00100000:1.0:1789672841.542136:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738409728 00000100:00100000:1.0:1789672841.542150:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738408832 00000100:00100000:1.0:1789672841.542153:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738408832 00000100:00100000:1.0:1789672841.542172:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789672841.542182:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738408576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.542534:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738408576:12345-0@lo:400:kworker.0 Request processed in 350us (1657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672841.542544:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789672841.542581:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789672841.542587:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738409088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.542619:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738409088:12345-0@lo:400:kworker.0 Request processed in 33us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672841.542625:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789672841.542640:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789672841.542645:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738409600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.542708:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738409600:12345-0@lo:400:kworker.0 Request processed in 64us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672841.542714:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789672841.542726:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789672841.542732:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738409216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.542764:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738409216:12345-0@lo:400:kworker.0 Request processed in 32us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672841.542770:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789672841.542779:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789672841.542785:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738409728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.542810:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738409728:12345-0@lo:400:kworker.0 Request processed in 25us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672841.542815:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789672841.542825:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789672841.542831:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738408832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.542869:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738408832:12345-0@lo:400:kworker.0 Request processed in 38us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672841.542875:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789672841.542915:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738408448 00000100:00100000:1.0:1789672841.542923:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738408448 00000100:00100000:1.0:1789672841.542959:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789672841.542966:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738408448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.542998:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738408448:12345-0@lo:400:kworker.0 Request processed in 33us (1869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672841.543003:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789672841.543574:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738408960 00000100:00100000:1.0:1789672841.543581:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738408960 00000100:00100000:1.0:1789672841.543624:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738408704 00000100:00100000:1.0:1789672841.543628:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738408704 00000100:00100000:1.0:1789672841.543644:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789672841.543651:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738408960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672841.543796:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789672841.543817:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738410112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672841.543867:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672841.543917:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738410112 00000100:00100000:3.0:1789672841.543922:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738410112 00000100:00100000:3.0:1789672841.543966:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789672841.543975:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738410112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789672841.544007:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672841.544065:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738410112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672841.544071:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1789672841.544134:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8c8e00 x1876607738410112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672841.544158:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738410112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672841.544460:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789672841.544474:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738408704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672841.544530:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738408704:12345-0@lo:400:kworker.0 Request processed in 60us (2815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672841.544538:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789672841.544955:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738408960:12345-0@lo:400:kworker.0 Request processed in 1302us (3771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672841.544962:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789672841.544991:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738409472 00000100:00100000:1.0:1789672841.545000:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738409472 00000100:00100000:1.0:1789672841.545046:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738409984 00000100:00100000:1.0:1789672841.545050:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738409984 00000100:00100000:1.0:1789672841.545061:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738409344 00000100:00100000:1.0:1789672841.545065:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738409344 00000100:00100000:1.0:1789672841.545078:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738409856 00000100:00100000:1.0:1789672841.545081:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738409856 00000100:00100000:1.0:1789672841.545098:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789672841.545104:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738409472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.545172:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738409472:12345-0@lo:400:kworker.0 Request processed in 68us (3950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672841.545180:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789672841.545192:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789672841.545198:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738409984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.545226:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738409984:12345-0@lo:400:kworker.0 Request processed in 28us (3627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672841.545244:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789672841.545328:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789672841.545335:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738409344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.545372:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738409344:12345-0@lo:400:kworker.0 Request processed in 38us (3473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672841.545378:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789672841.545388:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789672841.545393:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738409856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.545419:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738409856:12345-0@lo:400:kworker.0 Request processed in 26us (3481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672841.545424:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1789672841.545473:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672841.545478:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789672841.545481:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789672841.545486:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672841.545523:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738408832:0@lo:400:kworker.0 00010000:00080000:1.0:1789672841.545540:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462dce00 x1876607738409344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672841.545566:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738409344:0@lo:400:kworker.0 00010000:00080000:1.0:1789672841.545582:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462ddc00 x1876607738409856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672841.545590:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738409856:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.545601:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738408704:0@lo:400:kworker.0 00010000:00080000:1.0:1789672841.545615:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7c405880 x1876607738409216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672841.545622:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738409216:0@lo:400:kworker.0 00010000:00080000:1.0:1789672841.545635:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462dc700 x1876607738409728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672841.545644:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738409728:0@lo:400:kworker.0 00000100:00100000:2.0:1789672841.549829:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789672841.549863:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738410240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789672841.549965:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672841.550049:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738410240 00000100:00100000:2.0:1789672841.550059:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738410240 00000100:00100000:2.0:1789672841.550130:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789672841.550142:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738410240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789672841.550174:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672841.550242:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738410240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672841.550250:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:2.0:1789672841.550530:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8c8000 x1876607738410240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672841.550555:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738410240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789672841.551207:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738408448:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.551225:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738408960:0@lo:400:kworker.0 00010000:00080000:1.0:1789672841.551462:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462de300 x1876607738409472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672841.551474:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738409472:0@lo:400:kworker.0 00010000:00080000:1.0:1789672841.551489:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462df800 x1876607738409984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672841.551497:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738409984:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.551513:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738408576:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.551543:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738409088:0@lo:400:kworker.0 00000100:00100000:1.0:1789672841.551556:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738409600:0@lo:400:kworker.0 00010000:00010000:2.0:1789672842.435889:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672843.075827:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672843.075855:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738410368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789672843.075932:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672843.075993:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738410368 00000100:00100000:1.0:1789672843.076001:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738410368 00000100:00100000:1.0:1789672843.076054:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789672843.076062:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738410368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789672843.076110:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672843.076157:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738410368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672843.076166:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1789672843.076190:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789672843.076329:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d938a80 x1876607738410368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672843.076354:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738410368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789672843.076473:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738410496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672843.076503:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672843.076535:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738410496 00000100:00100000:3.0:1789672843.076539:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738410496 00000100:00100000:3.0:1789672843.076566:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789672843.076572:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738410496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672843.076583:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672843.076613:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738410496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672843.076632:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789672843.076646:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789672843.076683:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5aa680 x1876607738410496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672843.076694:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738410496:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789672843.460815:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672844.099801:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738410624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789672844.099872:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672844.101449:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738410624 00000100:00100000:2.0:1789672844.101462:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738410624 00000100:00100000:2.0:1789672844.101518:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789672844.101528:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738410624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789672844.101567:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789672844.101649:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738410624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672844.101686:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789672844.101741:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738410624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789672844.248600:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672844.248641:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672844.248696:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672844.248729:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672844.248749:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672844.248770:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672844.248810:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672844.248840:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714213632 00000100:00100000:3.0:1789672844.248851:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714213632 00000100:00100000:3.0:1789672844.248913:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714213760 00000100:00100000:3.0:1789672844.248917:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714213760 00000100:00100000:3.0:1789672844.248941:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:3.0:1789672844.248951:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714213632:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672844.249026:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714213632:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 76us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672844.249034:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:3.0:1789672844.249051:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:3.0:1789672844.249069:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714213760:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672844.249106:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714213760:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 49us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672844.249112:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:3.0:1789672844.249131:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714212992 00000100:00100000:3.0:1789672844.249135:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714212992 00000100:00100000:3.0:1789672844.249162:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 310 00000100:00100000:3.0:1789672844.249170:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714212992:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672844.249197:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714212992:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 30us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672844.249214:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 310 00000100:00100000:3.0:1789672844.249243:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714213120 00000100:00100000:3.0:1789672844.249247:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714213120 00000100:00100000:3.0:1789672844.249272:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714213376 00000100:00100000:3.0:1789672844.249275:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714213376 00000100:00100000:3.0:1789672844.249287:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714213248 00000100:00100000:3.0:1789672844.249289:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714213248 00000100:00100000:3.0:1789672844.249300:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714213504 00000100:00100000:3.0:1789672844.249302:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714213504 00000100:00100000:3.0:1789672844.249315:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 162 00000100:00100000:3.0:1789672844.249321:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2397:x1876607714213120:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672844.249346:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2397:x1876607714213120:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672844.249351:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 162 00000100:00100000:3.0:1789672844.249363:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 163 00000100:00100000:3.0:1789672844.249367:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714213376:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672844.249386:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714213376:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 19us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672844.249398:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 163 00000100:00100000:3.0:1789672844.249411:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 164 00000100:00100000:3.0:1789672844.249416:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714213248:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672844.249438:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714213248:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 22us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672844.249442:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 164 00000100:00100000:3.0:1789672844.249452:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 165 00000100:00100000:3.0:1789672844.249458:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714213504:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672844.249480:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714213504:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 22us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672844.249486:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 165 00000100:00080000:3.0:1789672844.249509:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789672844.249513:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789672844.249515:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789672844.249517:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789672844.483915:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672845.124154:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672845.124179:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738410752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789672845.124268:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672845.127265:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738410752 00000100:00100000:2.0:1789672845.127284:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738410752 00000100:00100000:2.0:1789672845.127354:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789672845.127364:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738410752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789672845.127405:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789672845.127486:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738410752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (3218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672845.127493:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789672845.136931:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738410752:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789672845.509218:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672846.533096:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672846.659946:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738411008:0@lo:400:kworker.0 00000100:00100000:0.0:1789672846.660210:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738410880:0@lo:400:kworker.0 00000100:00100000:2.0:1789672846.660339:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738411264:0@lo:400:kworker.0 00000100:00100000:0.0:1789672846.660755:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672846.660756:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672846.660812:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738411392:0@lo:400:kworker.0 00000100:00100000:1.0:1789672846.660814:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738411520:0@lo:400:kworker.0 00000100:00100000:0.0:1789672846.660852:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672846.660858:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672846.660879:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738411904:0@lo:400:kworker.0 00000100:00100000:1.0:1789672846.660891:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738412032:0@lo:400:kworker.0 00000100:00100000:0.0:1789672846.660907:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672846.660930:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672846.661026:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672846.661049:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738411776:0@lo:400:kworker.0 00000100:00100000:2.0:1789672846.661070:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672846.661088:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738412288:0@lo:400:kworker.0 00000100:00100000:2.0:1789672846.661120:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672846.661211:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738411904 00000100:00100000:2.0:1789672846.661219:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738411904 00000100:00100000:0.0:1789672846.661400:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738412416:0@lo:400:kworker.0 00000100:00100000:0.0:1789672846.661426:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672846.661620:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738411392 00000100:00100000:0.0:1789672846.661624:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738411392 00000100:00100000:1.0:1789672846.661631:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789672846.661650:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738412544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672846.661681:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789672846.661692:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738411392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672846.661711:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672846.661739:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738411136:0@lo:400:kworker.0 00000100:00100000:0.0:1789672846.661758:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738411392:12345-0@lo:400:kworker.0 Request processed in 67us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672846.661767:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789672846.661771:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672846.661795:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876607738411648:0@lo:400:kworker.0 00000100:00100000:1.0:1789672846.661817:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672846.661838:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738412160:0@lo:400:kworker.0 00000100:00100000:1.0:1789672846.661860:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672846.661873:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789672846.661879:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738412672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789672846.661902:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672846.661933:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738410880 00000100:00100000:1.0:1789672846.661938:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738410880 00000100:00100000:0.0:1789672846.663052:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738411136 00000100:00100000:0.0:1789672846.663059:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738411136 00000100:00100000:0.0:1789672846.663083:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789672846.663090:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738411136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672846.663163:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738411136:12345-0@lo:400:kworker.0 Request processed in 74us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672846.663171:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789672846.663194:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738411776 00000100:00100000:0.0:1789672846.663198:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738411776 00000100:00100000:0.0:1789672846.663217:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738412288 00000100:00100000:0.0:1789672846.663219:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738412288 00000100:00100000:0.0:1789672846.663233:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738412416 00000100:00100000:0.0:1789672846.663236:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738412416 00000100:00100000:0.0:1789672846.663250:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789672846.663257:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738411904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672846.663358:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789672846.663365:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789672846.663372:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3636:x1876607738410880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672846.663379:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738411776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672846.663419:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738411776:12345-0@lo:400:kworker.0 Request processed in 47us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672846.663425:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789672846.663544:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3636:x1876607738410880:12345-0@lo:400:kworker.0 Request processed in 176us (2794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672846.663551:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1789672846.663586:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738411008 00000100:00100000:1.0:1789672846.663590:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738411008 00000100:00100000:1.0:1789672846.663611:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738411520 00000100:00100000:2.0:1789672846.663614:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789672846.663614:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738411520 00000100:00100000:2.0:1789672846.663629:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738412288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672846.663633:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738412032 00000100:00100000:1.0:1789672846.663637:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738412032 00000100:00100000:1.0:1789672846.663679:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738411264 00000100:00100000:1.0:1789672846.663683:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738411264 00000100:00100000:2.0:1789672846.663692:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738412288:12345-0@lo:400:kworker.0 Request processed in 66us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672846.663699:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738411648 00000100:00100000:2.0:1789672846.663703:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789672846.663705:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738411648 00000100:00100000:2.0:1789672846.663721:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789672846.663730:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738412416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672846.663741:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738412160 00000100:00100000:1.0:1789672846.663747:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738412160 00000100:00100000:2.0:1789672846.663764:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738412416:12345-0@lo:400:kworker.0 Request processed in 34us (2335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672846.663771:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789672846.663776:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789672846.663783:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738411008:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789672846.663802:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789672846.663807:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789672846.663810:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789672846.663814:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672846.663824:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738411008:12345-0@lo:400:kworker.0 Request processed in 43us (3072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672846.663831:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789672846.663850:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789672846.663857:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738411520:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789672846.663868:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462dc700 x1876607738411776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672846.663888:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738411520:12345-0@lo:400:kworker.0 Request processed in 31us (3032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672846.663894:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789672846.663906:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789672846.663911:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738412032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672846.663942:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738412032:12345-0@lo:400:kworker.0 Request processed in 30us (3013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672846.663948:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789672846.664027:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738411776:0@lo:400:kworker.0 00010000:00080000:2.0:1789672846.664045:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7c404000 x1876607738412288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672846.664061:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738412288:0@lo:400:kworker.0 00000100:00100000:1.0:1789672846.664078:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789672846.664088:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738411264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672846.664130:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738411264:12345-0@lo:400:kworker.0 Request processed in 44us (3113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672846.664136:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789672846.664148:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789672846.664155:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876607738411648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672846.664348:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876607738411648:12345-0@lo:400:kworker.0 Request processed in 193us (2529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672846.664362:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789672846.664377:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789672846.664383:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738412160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672846.665140:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738411904:12345-0@lo:400:kworker.0 Request processed in 1880us (4229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672846.665150:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789672846.665232:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738410880:0@lo:400:kworker.0 00000100:00100000:0.0:1789672846.665249:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738411392:0@lo:400:kworker.0 00010000:00080000:0.0:1789672846.665261:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462ddc00 x1876607738411904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672846.665271:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738411904:0@lo:400:kworker.0 00000100:00100000:1.0:1789672846.665498:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738412160:12345-0@lo:400:kworker.0 Request processed in 1115us (3637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672846.665505:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789672846.665537:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738412544 00000100:00100000:1.0:1789672846.665543:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738412544 00000100:00100000:1.0:1789672846.665582:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738412672 00000100:00100000:1.0:1789672846.665586:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738412672 00000100:00100000:1.0:1789672846.665601:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789672846.665607:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738412544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789672846.665629:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672846.665681:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738412544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (3971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672846.665687:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789672846.665699:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789672846.665705:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738412672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789672846.665714:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672846.665737:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738412672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (3835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672846.665743:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789672846.665832:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738411264:0@lo:400:kworker.0 00010000:00080000:1.0:1789672846.665897:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47907100 x1876607738412672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672846.665928:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738412672:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789672846.665942:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47907b80 x1876607738412544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672846.665953:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738412544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672846.665964:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738411136:0@lo:400:kworker.0 00010000:00080000:1.0:1789672846.665975:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462de300 x1876607738411648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672846.665984:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876607738411648:0@lo:400:kworker.0 00010000:00080000:1.0:1789672846.665994:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7c406d80 x1876607738412160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672846.666001:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738412160:0@lo:400:kworker.0 00000100:00100000:1.0:1789672846.666013:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738411008:0@lo:400:kworker.0 00000100:00100000:1.0:1789672846.666036:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738411520:0@lo:400:kworker.0 00000100:00100000:1.0:1789672846.666047:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738412032:0@lo:400:kworker.0 00010000:00080000:0.0:1789672846.666625:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7c405880 x1876607738412416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672846.666638:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738412416:0@lo:400:kworker.0 00000020:00000004:0.0:1789672847.300490:0:12500:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789672847.301474:0:12500:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789672847.560034:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672848.196743:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789672848.196771:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738412800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672848.196854:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672848.196926:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738412800 00000100:00100000:1.0:1789672848.196934:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738412800 00000100:00100000:1.0:1789672848.197005:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789672848.197015:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738412800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672848.197065:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672848.197114:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738412800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672848.197122:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1789672848.197143:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789672848.197182:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8dea00 x1876607738412800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672848.197202:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738412800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672848.197733:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738412928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789672848.197766:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672848.197867:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738412928 00000100:00100000:0.0:1789672848.197873:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738412928 00000100:00100000:0.0:1789672848.197906:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789672848.197913:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738412928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789672848.197927:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672848.197962:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738412928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672848.197968:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1789672848.198058:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789672848.198085:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d86f480 x1876607738412928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672848.198100:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738412928:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789672848.589225:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672849.220097:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672849.220130:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738413056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672849.220266:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672849.220332:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738413056 00000100:00100000:1.0:1789672849.220341:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738413056 00000100:00100000:1.0:1789672849.220389:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789672849.220398:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738413056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789672849.220431:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789672849.220478:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738413056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672849.220485:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789672849.220541:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738413056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789672849.369610:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672849.369709:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672849.369737:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672849.369761:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672849.369780:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672849.369799:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672849.369863:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672849.369905:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714214016 00000100:00100000:0.0:1789672849.369914:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714214016 00000100:00100000:0.0:1789672849.369983:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714214272 00000100:00100000:0.0:1789672849.369987:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714214272 00000100:00100000:0.0:1789672849.370003:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714214144 00000100:00100000:0.0:1789672849.370006:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714214144 00000100:00100000:0.0:1789672849.370018:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714214400 00000100:00100000:0.0:1789672849.370020:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714214400 00000100:00100000:0.0:1789672849.370037:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 172 00000100:00100000:0.0:1789672849.370047:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714214016:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672849.370121:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714214016:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 75us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672849.370139:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 172 00000100:00100000:0.0:1789672849.370158:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 173 00000100:00100000:0.0:1789672849.370164:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714214272:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672849.370200:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714214272:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 26us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672849.370207:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 173 00000100:00100000:0.0:1789672849.370220:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 174 00000100:00100000:0.0:1789672849.370226:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2395:x1876607714214144:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672849.370249:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2395:x1876607714214144:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672849.370256:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 174 00000100:00100000:0.0:1789672849.370269:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 175 00000100:00100000:0.0:1789672849.370274:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2395:x1876607714214400:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672849.370295:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2395:x1876607714214400:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 21us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672849.370300:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 175 00000100:00100000:0.0:1789672849.370319:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714214528 00000100:00100000:0.0:1789672849.370323:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714214528 00000100:00100000:0.0:1789672849.370350:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714214656 00000100:00100000:0.0:1789672849.370353:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714214656 00000100:00100000:0.0:1789672849.370375:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:0.0:1789672849.370382:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714214528:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672849.370411:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714214528:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 30us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672849.370438:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:0.0:1789672849.370450:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:0.0:1789672849.370457:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2395:x1876607714214656:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672849.370482:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2395:x1876607714214656:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 26us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672849.370488:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00080000:0.0:1789672849.370515:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672849.370519:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789672849.370522:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789672849.370524:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672849.370765:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714213888 00000100:00100000:3.0:1789672849.370771:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714213888 00000100:00100000:3.0:1789672849.370808:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 312 00000100:00100000:3.0:1789672849.370815:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2395:x1876607714213888:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672849.370852:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2395:x1876607714213888:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 38us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672849.370859:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 312 00000020:00000004:1.0:1789672849.402397:0:12597:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789672849.403653:0:12597:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789672849.603870:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672850.248738:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672850.248807:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738413184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789672850.248872:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672850.249005:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738413184 00000100:00100000:1.0:1789672850.249014:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738413184 00000100:00100000:1.0:1789672850.249067:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789672850.249077:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738413184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789672850.249113:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789672850.249162:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738413184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672850.249169:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789672850.249256:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738413184:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789672850.631838:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789672851.514587:0:12694:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789672851.514856:0:12694:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789672851.652484:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672851.780879:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738413312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789672851.781011:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672851.781112:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738413312 00000100:00100000:1.0:1789672851.781122:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738413312 00000100:00100000:1.0:1789672851.781191:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789672851.781201:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738413312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789672851.781236:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672851.781283:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738413312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672851.781290:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1789672851.781312:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789672851.781396:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d938000 x1876607738413312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672851.781416:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738413312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789672851.781617:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738413568:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.781651:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672851.781698:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738414080:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.781719:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672851.781734:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738414592:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.781752:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672851.781770:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789672851.781776:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738413696:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.781820:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672851.781855:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876607738414208:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.781878:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672851.781894:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738414720:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.781913:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672851.781955:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738413568 00000100:00100000:0.0:1789672851.781959:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738413568 00000100:00100000:0.0:1789672851.781987:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738414080 00000100:00100000:0.0:1789672851.781990:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738414080 00000100:00100000:0.0:1789672851.782011:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738414592 00000100:00100000:0.0:1789672851.782014:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738414592 00000100:00100000:0.0:1789672851.782026:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738414208 00000100:00100000:0.0:1789672851.782029:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738414208 00000100:00100000:0.0:1789672851.782041:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738414720 00000100:00100000:0.0:1789672851.782043:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738414720 00000100:00100000:0.0:1789672851.782057:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789672851.782064:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738413568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.782123:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738413568:12345-0@lo:400:kworker.0 Request processed in 59us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672851.782129:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789672851.782144:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789672851.782150:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738414080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.782174:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738414080:12345-0@lo:400:kworker.0 Request processed in 25us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672851.782179:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789672851.782189:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789672851.782195:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738414592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.782218:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738414592:12345-0@lo:400:kworker.0 Request processed in 24us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672851.782233:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789672851.782245:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789672851.782250:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876607738414208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.782277:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876607738414208:12345-0@lo:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672851.782282:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789672851.782294:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789672851.782299:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738414720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.782344:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738414720:12345-0@lo:400:kworker.0 Request processed in 45us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672851.782350:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789672851.782376:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738413696 00000100:00100000:0.0:1789672851.782380:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738413696 00000100:00100000:0.0:1789672851.782405:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789672851.782411:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738413696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.782441:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738413696:12345-0@lo:400:kworker.0 Request processed in 29us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672851.782446:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1789672851.782468:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789672851.782471:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672851.782482:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738413824:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.782509:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672851.782527:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738414336:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.782561:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672851.782577:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738414848:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.782604:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672851.782622:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789672851.782627:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738413440:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.782653:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672851.782699:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738413952:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.782721:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672851.782739:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7dac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738414464:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.782759:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672851.782784:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738414336 00000100:00100000:0.0:1789672851.782788:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738414336 00000100:00100000:0.0:1789672851.782816:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738414848 00000100:00100000:0.0:1789672851.782818:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738414848 00000100:00100000:0.0:1789672851.782831:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738414464 00000100:00100000:0.0:1789672851.782833:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738414464 00000100:00100000:0.0:1789672851.782846:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789672851.782852:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738414336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.782885:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738414336:12345-0@lo:400:kworker.0 Request processed in 34us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672851.782892:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789672851.782902:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789672851.782908:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738414848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.782944:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d869500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738414848:12345-0@lo:400:kworker.0 Request processed in 36us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672851.782949:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789672851.782958:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789672851.782963:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738414464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.783012:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738414464:12345-0@lo:400:kworker.0 Request processed in 49us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672851.783018:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789672851.783038:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738413952 00000100:00100000:0.0:1789672851.783041:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738413952 00000100:00100000:0.0:1789672851.783062:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789672851.783069:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738413952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.783098:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738413952:12345-0@lo:400:kworker.0 Request processed in 29us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672851.783104:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1789672851.783125:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672851.783129:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672851.783159:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46802680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738413696:0@lo:400:kworker.0 00010000:00080000:0.0:1789672851.783172:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb46800e00 x1876607738414208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672851.783183:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46800e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876607738414208:0@lo:400:kworker.0 00010000:00080000:0.0:1789672851.783193:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5ad180 x1876607738414720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672851.783202:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738414720:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.783213:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738413568:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.783223:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46800000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738414080:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.783233:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738414592:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.783271:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738413824 00000100:00100000:0.0:1789672851.783280:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738413824 00000100:00100000:0.0:1789672851.783306:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789672851.783312:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738413824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.783341:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738413824:12345-0@lo:400:kworker.0 Request processed in 30us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672851.783348:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789672851.783375:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738413952:0@lo:400:kworker.0 00010000:00080000:0.0:1789672851.783385:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7dac1500 x1876607738414464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672851.783394:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7dac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738414464:0@lo:400:kworker.0 00000100:00100000:0.0:1789672851.783404:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738413824:0@lo:400:kworker.0 00010000:00080000:0.0:1789672851.783412:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb46801c00 x1876607738414336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672851.783419:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738414336:0@lo:400:kworker.0 00010000:00080000:0.0:1789672851.783427:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5aed80 x1876607738414848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672851.783433:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738414848:0@lo:400:kworker.0 00000100:00100000:2.0:1789672851.785381:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672851.785402:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738414976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672851.785472:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672851.785521:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738414976 00000100:00100000:2.0:1789672851.785528:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738414976 00000100:00100000:2.0:1789672851.785577:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789672851.785588:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738414976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789672851.785611:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672851.785682:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738414976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672851.785689:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1789672851.785735:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47905880 x1876607738414976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672851.785759:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738414976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672851.785854:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738413440 00000100:00100000:1.0:1789672851.785870:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738413440 00000100:00100000:1.0:1789672851.785903:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789672851.785911:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3635:x1876607738413440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672851.785972:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3635:x1876607738413440:12345-0@lo:400:kworker.0 Request processed in 63us (3318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672851.785979:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789672851.786224:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738413440:0@lo:400:kworker.0 00010000:00010000:0.0:1789672852.680800:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672853.317882:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672853.317917:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738415104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789672853.317987:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672853.318172:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738415232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672853.318198:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672853.318275:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738415104 00000100:00100000:3.0:1789672853.318284:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738415104 00000100:00100000:3.0:1789672853.318348:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738415232 00000100:00100000:3.0:1789672853.318352:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738415232 00000100:00100000:3.0:1789672853.318371:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789672853.318380:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738415104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789672853.318409:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672853.318455:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738415104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672853.318462:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789672853.318492:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789672853.318499:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738415232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672853.318509:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672853.318532:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738415232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672853.318538:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1789672853.318576:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f5a9f80 x1876607738415232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672853.318594:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738415232:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789672853.318605:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47905880 x1876607738415104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672853.318615:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738415104:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789672853.318729:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789672853.704974:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789672854.102627:0:12792:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789672854.102925:0:12792:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789672854.348851:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672854.348874:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738415360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789672854.348962:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672854.351783:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738415360 00000100:00100000:3.0:1789672854.351801:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738415360 00000100:00100000:3.0:1789672854.352008:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789672854.352019:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738415360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789672854.352059:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789672854.352148:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738415360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (3186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672854.352156:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789672854.352240:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738415360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789672854.484052:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672854.484097:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672854.484132:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672854.484159:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714215040 00000100:00100000:3.0:1789672854.484169:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714215040 00000100:00100000:3.0:1789672854.484228:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714215296 00000100:00100000:3.0:1789672854.484231:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714215296 00000100:00100000:3.0:1789672854.484256:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 182 00000100:00100000:3.0:1789672854.484268:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714215040:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672854.484348:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714215040:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 83us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672854.484356:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 182 00000100:00100000:3.0:1789672854.484388:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 183 00000100:00100000:3.0:1789672854.484396:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714215296:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672854.484433:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714215296:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 38us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672854.484439:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 183 00000100:00080000:3.0:1789672854.484470:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789672854.484980:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714214784 00000100:00100000:1.0:1789672854.484988:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714214784 00000100:00100000:1.0:1789672854.485045:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 314 00000100:00100000:1.0:1789672854.485053:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714214784:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672854.485098:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714214784:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 46us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672854.485104:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 314 00000100:00100000:0.0:1789672854.487598:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672854.487752:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672854.488455:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714214912 00000100:00100000:1.0:1789672854.488467:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714214912 00000100:00100000:1.0:1789672854.488541:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714215168 00000100:00100000:1.0:1789672854.488545:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714215168 00000100:00100000:1.0:1789672854.488570:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 184 00000100:00100000:1.0:1789672854.488581:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714214912:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672854.488690:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714214912:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 110us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672854.488698:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 184 00000100:00100000:1.0:1789672854.488717:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 185 00000100:00100000:1.0:1789672854.488724:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714215168:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672854.488751:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714215168:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 28us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672854.488780:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 185 00000100:00100000:1.0:1789672854.488841:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672854.488911:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672854.489426:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714215424 00000100:00100000:1.0:1789672854.489433:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714215424 00000100:00100000:1.0:1789672854.489467:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714215552 00000100:00100000:1.0:1789672854.489470:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714215552 00000100:00100000:1.0:1789672854.489494:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:1.0:1789672854.489502:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2394:x1876607714215424:12345-192.168.201.50@tcp:9:kworker.0 00000020:00000080:1.0:1789672854.489528:0:8494:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9965136 00000100:00080000:1.0:1789672854.489540:0:8494:0:(import.c:65:import_set_state_nolock()) ffff8cfb47964000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789672854.489589:0:8494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789672854.489756:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+2:2394:x1876607714215424:12345-192.168.201.50@tcp:9:kworker.0 Request processed in 254us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672854.489764:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:1.0:1789672854.489779:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:1.0:1789672854.489785:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2394:x1876607714215552:12345-192.168.201.50@tcp:9:kworker.0 00000020:00000080:1.0:1789672854.489798:0:8494:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c996513d 00000100:00080000:1.0:1789672854.489803:0:8494:0:(import.c:65:import_set_state_nolock()) ffff8cfb47a69800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789672854.489827:0:8494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789672854.489909:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+2:2394:x1876607714215552:12345-192.168.201.50@tcp:9:kworker.0 Request processed in 124us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672854.489914:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00010000:00010000:1.0:1789672854.489943:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672854.489949:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789672854.490432:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672854.490438:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789672854.490442:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789672854.723787:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672855.363968:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672855.364013:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738415488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789672855.364091:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672855.364162:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738415488 00000100:00100000:0.0:1789672855.364170:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738415488 00000100:00100000:0.0:1789672855.364222:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789672855.364233:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738415488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789672855.364270:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789672855.364317:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738415488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672855.364325:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789672855.364389:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738415488:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789672855.748101:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789672856.191859:0:12890:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789672856.192125:0:12890:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789672856.771809:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672856.899961:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738415616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672856.900048:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672856.900285:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738415872:0@lo:400:kworker.0 00000100:00100000:2.0:1789672856.900320:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672856.900343:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738416384:0@lo:400:kworker.0 00000100:00100000:2.0:1789672856.900363:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672856.900383:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738416896:0@lo:400:kworker.0 00000100:00100000:2.0:1789672856.900403:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672856.900439:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789672856.900445:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738416000:0@lo:400:kworker.0 00000100:00100000:2.0:1789672856.900471:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672856.900492:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738416512:0@lo:400:kworker.0 00000100:00100000:2.0:1789672856.900511:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672856.900528:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738417024:0@lo:400:kworker.0 00000100:00100000:2.0:1789672856.900547:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672856.900577:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738415872 00000100:00100000:2.0:1789672856.900584:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738415872 00000100:00100000:2.0:1789672856.900633:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738416384 00000100:00100000:2.0:1789672856.900637:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738416384 00000100:00100000:2.0:1789672856.900685:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738416896 00000100:00100000:2.0:1789672856.900688:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738416896 00000100:00100000:2.0:1789672856.900701:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738416512 00000100:00100000:2.0:1789672856.900704:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738416512 00000100:00100000:2.0:1789672856.900714:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738417024 00000100:00100000:2.0:1789672856.900716:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738417024 00000100:00100000:2.0:1789672856.900731:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789672856.900738:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738415872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672856.900810:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738415872:12345-0@lo:400:kworker.0 Request processed in 72us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672856.900818:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789672856.900849:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789672856.900855:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738416384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672856.900879:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738416384:12345-0@lo:400:kworker.0 Request processed in 25us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672856.900884:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789672856.900894:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789672856.900899:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738416896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672856.900922:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738416896:12345-0@lo:400:kworker.0 Request processed in 22us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672856.900927:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789672856.900937:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789672856.900942:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738416512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672856.900966:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738416512:12345-0@lo:400:kworker.0 Request processed in 24us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672856.900971:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789672856.900981:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789672856.900987:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738417024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672856.901010:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738417024:12345-0@lo:400:kworker.0 Request processed in 24us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672856.901016:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789672856.901037:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738416000 00000100:00100000:2.0:1789672856.901041:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738416000 00000100:00100000:2.0:1789672856.901076:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789672856.901082:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738416000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672856.901114:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738416000:12345-0@lo:400:kworker.0 Request processed in 32us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672856.901119:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1789672856.901140:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789672856.901143:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672856.901173:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738416000:0@lo:400:kworker.0 00010000:00080000:2.0:1789672856.901185:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47905880 x1876607738416512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672856.901196:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738416512:0@lo:400:kworker.0 00010000:00080000:2.0:1789672856.901206:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7c406d80 x1876607738417024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672856.901214:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738417024:0@lo:400:kworker.0 00000100:00100000:2.0:1789672856.901223:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738415872:0@lo:400:kworker.0 00000100:00100000:2.0:1789672856.901230:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738416384:0@lo:400:kworker.0 00000100:00100000:2.0:1789672856.901237:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738416896:0@lo:400:kworker.0 00000100:00100000:1.0:1789672856.902115:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738415616 00000100:00100000:1.0:1789672856.902124:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738415616 00000100:00100000:1.0:1789672856.902177:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789672856.902187:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738415616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789672856.902214:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672856.902265:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738415616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (2218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672856.902271:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1789672856.902295:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789672856.902383:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738416128:0@lo:400:kworker.0 00000100:00100000:0.0:1789672856.902433:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672856.902475:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738416640:0@lo:400:kworker.0 00000100:00100000:0.0:1789672856.902502:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672856.902520:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738417152:0@lo:400:kworker.0 00000100:00100000:0.0:1789672856.902542:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789672856.902569:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47906300 x1876607738415616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672856.902588:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738415616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672856.902608:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789672856.902615:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738415744:0@lo:400:kworker.0 00000100:00100000:0.0:1789672856.902708:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672856.902732:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738416256:0@lo:400:kworker.0 00000100:00100000:0.0:1789672856.902757:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672856.902777:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738416768:0@lo:400:kworker.0 00000100:00100000:0.0:1789672856.902794:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672856.902821:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738416256 00000100:00100000:0.0:1789672856.902826:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738416256 00000100:00100000:0.0:1789672856.902874:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789672856.902882:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738416256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672856.902921:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738416256:12345-0@lo:400:kworker.0 Request processed in 40us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672856.902927:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789672856.902957:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738416256:0@lo:400:kworker.0 00000100:00100000:1.0:1789672856.903107:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738416640 00000100:00100000:1.0:1789672856.903111:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738416640 00000100:00100000:1.0:1789672856.903148:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738417152 00000100:00100000:1.0:1789672856.903151:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738417152 00000100:00100000:1.0:1789672856.903166:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738416768 00000100:00100000:1.0:1789672856.903169:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738416768 00000100:00100000:1.0:1789672856.903183:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789672856.903189:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738416640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672856.903228:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738416640:12345-0@lo:400:kworker.0 Request processed in 39us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672856.903234:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789672856.903246:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789672856.903252:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738417152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672856.903280:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738417152:12345-0@lo:400:kworker.0 Request processed in 29us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672856.903285:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789672856.903298:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789672856.903313:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738416768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672856.903342:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738416768:12345-0@lo:400:kworker.0 Request processed in 30us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672856.903347:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789672856.903369:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738415744 00000100:00100000:1.0:1789672856.903372:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738415744 00000100:00100000:1.0:1789672856.903393:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789672856.903398:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738415744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672856.903424:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738415744:12345-0@lo:400:kworker.0 Request processed in 26us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672856.903430:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789672856.903465:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738416128 00000100:00100000:1.0:1789672856.903469:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738416128 00000100:00100000:1.0:1789672856.903491:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789672856.903497:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738416128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672856.903523:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738416128:12345-0@lo:400:kworker.0 Request processed in 26us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672856.903528:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789672856.903550:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738415744:0@lo:400:kworker.0 00010000:00080000:1.0:1789672856.903561:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47907100 x1876607738416768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672856.903570:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738416768:0@lo:400:kworker.0 00000100:00100000:1.0:1789672856.903579:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738416128:0@lo:400:kworker.0 00010000:00080000:1.0:1789672856.903588:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47907b80 x1876607738416640/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672856.903606:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738416640:0@lo:400:kworker.0 00010000:00080000:1.0:1789672856.903616:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7c404000 x1876607738417152/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672856.903715:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738417152:0@lo:400:kworker.0 00000100:00100000:2.0:1789672856.904018:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789672856.904030:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738417280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789672856.904068:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672856.904101:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738417280 00000100:00100000:2.0:1789672856.904106:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738417280 00000100:00100000:2.0:1789672856.904135:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789672856.904142:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738417280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789672856.904166:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672856.904205:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738417280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672856.904212:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1789672856.904243:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7c404000 x1876607738417280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672856.904256:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738417280:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789672856.906889:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672856.906902:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789672857.796160:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672858.437019:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738417536:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789672858.437098:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672858.437177:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789672858.437184:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738417408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672858.437488:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672858.437530:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738417536 00000100:00100000:2.0:1789672858.437537:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738417536 00000100:00100000:2.0:1789672858.437589:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738417408 00000100:00100000:2.0:1789672858.437593:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738417408 00000100:00100000:2.0:1789672858.437610:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789672858.437618:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738417536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789672858.437650:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672858.437716:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738417536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672858.437718:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789672858.437737:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738417408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672858.437748:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672858.437878:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738417408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672858.439303:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1789672858.439533:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789672858.439586:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc4993ce00 x1876607738417408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672858.439636:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738417408:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789672858.439653:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7c404000 x1876607738417536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672858.439682:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738417536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789672858.444377:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:1.0:1789672858.820789:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672859.459950:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672859.466052:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738417664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672859.466152:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672859.476830:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738417664 00000100:00100000:2.0:1789672859.476852:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738417664 00000100:00100000:2.0:1789672859.476953:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789672859.476966:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738417664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789672859.477013:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789672859.478255:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738417664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1284us (12095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672859.478270:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789672859.480415:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738417664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672859.615219:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672859.615274:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672859.615311:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672859.615341:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672859.615371:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672859.615411:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714215936 00000100:00100000:1.0:1789672859.615421:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714215936 00000100:00100000:1.0:1789672859.615482:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714216192 00000100:00100000:1.0:1789672859.615485:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714216192 00000100:00100000:1.0:1789672859.615502:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714215808 00000100:00100000:1.0:1789672859.615519:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714215808 00000100:00100000:1.0:1789672859.615537:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714216064 00000100:00100000:1.0:1789672859.615540:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714216064 00000100:00100000:1.0:1789672859.615558:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 192 00000100:00100000:1.0:1789672859.615568:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714215936:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672859.616018:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 193 00000100:00100000:3.0:1789672859.616030:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714216192:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672859.616096:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714216192:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 68us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672859.616104:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 193 00000100:00100000:3.0:1789672859.616127:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 194 00000100:00100000:3.0:1789672859.616145:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714215808:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672859.616181:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714215808:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 38us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672859.616187:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 194 00000100:00100000:3.0:1789672859.616201:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 195 00000100:00100000:3.0:1789672859.616207:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714216064:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672859.616232:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714216064:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672859.616238:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 195 00000100:00080000:3.0:1789672859.616282:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789672859.616286:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789672859.616779:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714215936:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 1209us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672859.616819:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 192 00000100:00100000:2.0:1789672859.617093:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714215680 00000100:00100000:2.0:1789672859.617110:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714215680 00000100:00100000:2.0:1789672859.617178:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 316 00000100:00100000:2.0:1789672859.617187:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2396:x1876607714215680:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672859.617226:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2396:x1876607714215680:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 41us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672859.617233:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 316 00010000:00010000:2.0:1789672859.844424:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789672859.976023:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 33c1cd4d-7765-4bf5-8421-437f0a05573b 00000020:00000080:0.0:1789672859.976034:0:9507:0:(genops.c:885:class_export_put()) final put ffff8cfb47a6c000/33c1cd4d-7765-4bf5-8421-437f0a05573b 00000020:00000080:2.0:1789672859.976213:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb47a6c000/33c1cd4d-7765-4bf5-8421-437f0a05573b for lustre-OST0001 00000020:00000080:2.0:1789672859.976288:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb47a69800 for lustre-OST0001 00000001:00100000:2.0:1789672859.977094:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 33c1cd4d-7765-4bf5-8421-437f0a05573b 00000020:00000080:2.0:1789672859.977100:0:8423:0:(genops.c:885:class_export_put()) final put ffff8cfb47961800/33c1cd4d-7765-4bf5-8421-437f0a05573b 00000020:00000080:3.0:1789672859.977182:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb47961800/33c1cd4d-7765-4bf5-8421-437f0a05573b for lustre-OST0000 00000020:00000080:3.0:1789672859.977247:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb47964000 for lustre-OST0000 00000100:00100000:1.0:1789672860.486988:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738417792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789672860.487068:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672860.487167:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738417792 00000100:00100000:1.0:1789672860.487186:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738417792 00000100:00100000:1.0:1789672860.487349:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789672860.487359:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738417792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789672860.487394:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789672860.487440:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738417792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672860.487447:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789672860.487586:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738417792:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789672860.868861:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789672861.004621:0:13036:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789672861.893795:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672862.020492:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789672862.020518:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738417920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672862.020596:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672862.020701:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738417920 00000100:00100000:2.0:1789672862.020712:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738417920 00000100:00100000:2.0:1789672862.020780:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789672862.020881:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738417920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789672862.020912:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672862.020959:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738417920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672862.020966:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1789672862.021081:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47904380 x1876607738417920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672862.021100:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738417920:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789672862.021469:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789672862.021537:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738418432:0@lo:400:kworker.0 00000100:00100000:0.0:1789672862.021575:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672862.021608:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738418944:0@lo:400:kworker.0 00000100:00100000:0.0:1789672862.021633:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672862.021678:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738419456:0@lo:400:kworker.0 00000100:00100000:0.0:1789672862.021699:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672862.021717:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789672862.021731:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738418048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789672862.021769:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672862.021801:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738418560:0@lo:400:kworker.0 00000100:00100000:0.0:1789672862.021822:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672862.021836:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738419072:0@lo:400:kworker.0 00000100:00100000:0.0:1789672862.021855:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672862.021868:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738419584:0@lo:400:kworker.0 00000100:00100000:0.0:1789672862.021884:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672862.021927:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738418944 00000100:00100000:0.0:1789672862.021933:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738418944 00000100:00100000:0.0:1789672862.021977:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738419456 00000100:00100000:0.0:1789672862.021981:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738419456 00000100:00100000:0.0:1789672862.022184:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738418560 00000100:00100000:0.0:1789672862.022188:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738418560 00000100:00100000:0.0:1789672862.022211:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789672862.022221:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738418944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672862.022275:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738418944:12345-0@lo:400:kworker.0 Request processed in 55us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672862.022282:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789672862.022298:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789672862.022303:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738419456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672862.022330:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738419456:12345-0@lo:400:kworker.0 Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672862.022336:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789672862.022347:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789672862.022352:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738418560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672862.022390:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738418560:12345-0@lo:400:kworker.0 Request processed in 38us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672862.022397:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:0.0:1789672862.022417:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789672862.022440:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738418560:0@lo:400:kworker.0 00010000:00080000:0.0:1789672862.022453:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc41218a80 x1876607738418944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672862.022464:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738418944:0@lo:400:kworker.0 00010000:00080000:0.0:1789672862.022472:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc4121b480 x1876607738419456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672862.022480:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738419456:0@lo:400:kworker.0 00000100:00100000:1.0:1789672862.022592:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738418176:0@lo:400:kworker.0 00000100:00100000:1.0:1789672862.022636:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672862.022704:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738418688:0@lo:400:kworker.0 00000100:00100000:1.0:1789672862.022730:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672862.022761:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738419200:0@lo:400:kworker.0 00000100:00100000:1.0:1789672862.022810:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672862.022831:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789672862.022838:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738418304:0@lo:400:kworker.0 00000100:00100000:1.0:1789672862.022860:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672862.022879:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738418816:0@lo:400:kworker.0 00000100:00100000:1.0:1789672862.022901:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672862.022918:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738419328:0@lo:400:kworker.0 00000100:00100000:1.0:1789672862.022938:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672862.022964:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738418048 00000100:00100000:1.0:1789672862.022968:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738418048 00000100:00100000:1.0:1789672862.023134:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789672862.023143:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738418048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789672862.023163:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672862.023202:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738418048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672862.023210:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789672862.023248:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738419072 00000100:00100000:1.0:1789672862.023253:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738419072 00000100:00100000:1.0:1789672862.023278:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738419584 00000100:00100000:1.0:1789672862.023282:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738419584 00000100:00100000:1.0:1789672862.023294:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738419200 00000100:00100000:1.0:1789672862.023296:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738419200 00000100:00100000:1.0:1789672862.023309:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789672862.023315:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738419072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672862.023347:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738419072:12345-0@lo:400:kworker.0 Request processed in 32us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672862.023354:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789672862.023377:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789672862.023383:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738419584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672862.023411:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738419584:12345-0@lo:400:kworker.0 Request processed in 29us (1526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672862.023419:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789672862.023450:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789672862.023457:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738419200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672862.023492:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738419200:12345-0@lo:400:kworker.0 Request processed in 36us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672862.023498:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789672862.023525:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738418304 00000100:00100000:1.0:1789672862.023529:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738418304 00000100:00100000:1.0:1789672862.023547:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738418816 00000100:00100000:1.0:1789672862.023550:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738418816 00000100:00100000:1.0:1789672862.023561:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738419328 00000100:00100000:1.0:1789672862.023563:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738419328 00000100:00100000:1.0:1789672862.023576:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789672862.023582:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738418304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672862.023611:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738418304:12345-0@lo:400:kworker.0 Request processed in 29us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672862.023616:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789672862.023628:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789672862.023634:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738418816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672862.023693:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738418816:12345-0@lo:400:kworker.0 Request processed in 60us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672862.023699:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789672862.023713:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789672862.023725:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738419328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672862.023768:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738419328:12345-0@lo:400:kworker.0 Request processed in 44us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672862.023774:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789672862.023955:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738418176 00000100:00100000:0.0:1789672862.023960:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738418176 00000100:00100000:0.0:1789672862.023996:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789672862.024084:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738418176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672862.024206:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738418432 00000100:00100000:3.0:1789672862.024212:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738418432 00000100:00100000:3.0:1789672862.024245:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738418688 00000100:00100000:3.0:1789672862.024248:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738418688 00000100:00100000:3.0:1789672862.024262:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789672862.024268:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738418432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672862.024309:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738418432:12345-0@lo:400:kworker.0 Request processed in 41us (2734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672862.024315:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789672862.024327:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789672862.024332:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738418688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672862.024359:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738418688:12345-0@lo:400:kworker.0 Request processed in 27us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672862.024365:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:3.0:1789672862.024426:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789672862.024431:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789672862.024433:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789672862.024477:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb4744d880 x1876607738418048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672862.024499:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738418048:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789672862.024513:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc41218000 x1876607738419072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672862.024521:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738419072:0@lo:400:kworker.0 00010000:00080000:3.0:1789672862.024530:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc41219180 x1876607738419584/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672862.024554:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738419584:0@lo:400:kworker.0 00000100:00100000:3.0:1789672862.024567:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738418432:0@lo:400:kworker.0 00000100:00100000:3.0:1789672862.024622:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738418304:0@lo:400:kworker.0 00000100:00100000:3.0:1789672862.024631:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738418816:0@lo:400:kworker.0 00000100:00100000:3.0:1789672862.024640:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738419328:0@lo:400:kworker.0 00000100:00100000:3.0:1789672862.024650:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738418688:0@lo:400:kworker.0 00010000:00080000:3.0:1789672862.024686:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc4121ad80 x1876607738419200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672862.024694:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738419200:0@lo:400:kworker.0 00000100:00100000:0.0:1789672862.024885:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738418176:12345-0@lo:400:kworker.0 Request processed in 804us (2248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672862.024893:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789672862.025212:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738418176:0@lo:400:kworker.0 00010000:00010000:1.0:1789672862.916044:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672863.558309:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738419712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672863.558390:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672863.559505:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738419712 00000100:00100000:3.0:1789672863.559516:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738419712 00000100:00100000:3.0:1789672863.559604:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789672863.559612:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738419712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672863.559640:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672863.559723:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738419712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672863.559732:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:3.0:1789672863.559820:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d9f3100 x1876607738419712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672863.559851:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738419712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672863.560845:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672863.560859:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738419840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789672863.560905:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672863.560950:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738419840 00000100:00100000:0.0:1789672863.560955:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738419840 00000100:00100000:0.0:1789672863.561004:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789672863.561012:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738419840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789672863.561038:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672863.561079:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738419840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672863.561087:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1789672863.561124:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb4793aa00 x1876607738419840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672863.561140:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738419840:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789672863.940287:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672864.581378:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738419968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789672864.581449:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672864.581627:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738419968 00000100:00100000:3.0:1789672864.581638:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738419968 00000100:00100000:3.0:1789672864.581728:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789672864.581739:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738419968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789672864.581775:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789672864.582050:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738419968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789672864.582097:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738419968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 359us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672864.582104:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789672864.728916:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672864.729016:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672864.729051:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672864.729074:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672864.729100:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672864.729131:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714216448 00000100:00100000:2.0:1789672864.729140:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714216448 00000100:00100000:2.0:1789672864.729193:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714216576 00000100:00100000:2.0:1789672864.729196:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714216576 00000100:00100000:2.0:1789672864.729209:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714216704 00000100:00100000:2.0:1789672864.729220:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714216704 00000100:00100000:2.0:1789672864.729238:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714216832 00000100:00100000:2.0:1789672864.729240:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714216832 00000100:00100000:2.0:1789672864.729257:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 202 00000100:00100000:2.0:1789672864.729268:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2397:x1876607714216448:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672864.729353:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2397:x1876607714216448:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 87us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672864.729361:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 202 00000100:00100000:2.0:1789672864.729379:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 203 00000100:00100000:2.0:1789672864.729386:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714216576:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672864.729410:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714216576:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672864.729415:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 203 00000100:00100000:2.0:1789672864.729427:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 204 00000100:00100000:2.0:1789672864.729432:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714216704:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672864.729450:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714216704:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 18us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672864.729455:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 204 00000100:00100000:2.0:1789672864.729464:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 205 00000100:00100000:2.0:1789672864.729469:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714216832:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672864.729487:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714216832:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 18us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672864.729494:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 205 00000100:00080000:2.0:1789672864.729655:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789672864.729683:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672864.732690:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714216320 00000100:00100000:3.0:1789672864.732715:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714216320 00000100:00100000:2.0:1789672864.732871:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 318 00000100:00100000:2.0:1789672864.732883:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2398:x1876607714216320:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672864.732972:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2398:x1876607714216320:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 92us (4067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672864.732980:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 318 00010000:00010000:1.0:1789672864.963772:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789672865.348139:0:13184:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0ee88210 20000000:00000080:3.0:1789672865.348157:0:13184:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cfb47bb2c00 uarg=0000000000000000 20000000:01000000:3.0:1789672865.348201:0:13184:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789672865.348207:0:13184:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789672865.348212:0:13184:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789672865.352368:0:13185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1789672865.352588:0:13184:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789672865.359524:0:13184:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789672865.359559:0:13184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c9965144 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.359583:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d8cc600/0x6c78c4f8c99650d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f0f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.359593:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99650e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99650db expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.359600:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c99650f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99650e9 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.359607:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c99650fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99650f7 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.359613:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d8cce00/0x6c78c4f8c996510c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9965105 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.359621:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9965121 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f4e expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.360039:0:13184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c9965144 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.360100:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9965121 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f4e expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.360114:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9965121 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f4e expref: 12 pid: 6506 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672865.360130:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1876607738420096:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672865.360238:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d8cce00/0x6c78c4f8c996510c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9965105 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.360247:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc7d8cce00/0x6c78c4f8c996510c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9965105 expref: 23 pid: 6504 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672865.360256:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1876607738420224:0@lo:104: 00000100:00100000:1.0:1789672865.360296:0:13184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672865.360344:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c99650fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c99650f7 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.360352:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c99650fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c99650f7 expref: 23 pid: 6504 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672865.360360:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1876607738420352:0@lo:104: 00000100:00100000:1.0:1789672865.360379:0:13184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672865.360400:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c99650f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c99650e9 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.360407:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c99650f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c99650e9 expref: 23 pid: 6506 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672865.360426:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1876607738420480:0@lo:104: 00000100:00100000:1.0:1789672865.360448:0:13184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672865.360478:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738420224 00000100:00100000:1.0:1789672865.360486:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738420224 00000100:00100000:1.0:1789672865.360527:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738420352 00000100:00100000:1.0:1789672865.360530:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738420352 00000100:00100000:1.0:1789672865.360540:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738420480 00000100:00100000:1.0:1789672865.360542:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738420480 00000100:00100000:1.0:1789672865.360555:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789672865.360563:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:13184:x1876607738420224:12345-0@lo:104: 00010000:00010000:1.0:1789672865.360575:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9965105 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c996510c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.360623:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789672865.360638:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:13184:x1876607738420224:12345-0@lo:104: Request processed in 67us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672865.360646:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789672865.360702:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789672865.360708:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:13184:x1876607738420352:12345-0@lo:104: 00010000:00010000:1.0:1789672865.360716:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c99650f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99650fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.360747:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789672865.360752:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:13184:x1876607738420352:12345-0@lo:104: Request processed in 45us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672865.360758:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789672865.360783:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789672865.360797:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:13184:x1876607738420480:12345-0@lo:104: 00010000:00010000:1.0:1789672865.360804:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c99650e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99650f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.361100:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789672865.361106:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:13184:x1876607738420480:12345-0@lo:104: Request processed in 311us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672865.361112:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1789672865.361129:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789672865.361135:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9965105 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c996510c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.361141:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cda00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:1.0:1789672865.361145:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9965105 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c996510c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.361153:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9965105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c996510c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672865.361159:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9965105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c996510c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672865.361164:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789672865.361427:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9965105 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996510c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.361435:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789672865.361607:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738420608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789672865.361645:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672865.361979:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9965105 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996510c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.362001:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9965105 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996510c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.362016:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789672865.362020:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c99650f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99650fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.362026:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887200 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:1.0:1789672865.362041:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c99650f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c99650fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.362049:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c99650f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c99650fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672865.362057:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c99650f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c99650fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672865.362062:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789672865.362393:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672865.362551:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672865.362557:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c99650e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99650f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672865.362564:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a1e00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:2.0:1789672865.362567:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c99650e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c99650f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672865.362574:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c99650e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c99650f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672865.362581:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c99650e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c99650f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672865.362586:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789672865.365045:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738420608 00000100:00100000:0.0:1789672865.365061:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738420608 00010000:00010000:0.0:1789672865.365103:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d8cce00/0x6c78c4f8c996510c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9965105 expref: 24 pid: 6504 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672865.365142:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789672865.365151:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3636:x1876607738420608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789672865.365166:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672865.365171:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d8cce00/0x6c78c4f8c996510c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9965105 expref: 24 pid: 6504 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.365181:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d8cce00/0x6c78c4f8c996510c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9965105 expref: 24 pid: 6504 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.365214:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672865.365302:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3636:x1876607738420608:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (3655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672865.365311:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789672865.365356:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738420608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789672865.366016:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c99650f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99650fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672865.366232:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00010000:00010000:1.0:1789672865.366474:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672865.366506:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c99650f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99650fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.366516:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887200/0x6c78c4f8c99650f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99650fe expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.366532:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672865.366543:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672865.366545:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672865.366591:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99650e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c99650db expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.366603:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99650e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c99650db expref: 23 pid: 6506 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672865.366616:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1876607738420864:0@lo:104: 00000100:00100000:1.0:1789672865.366692:0:13184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789672865.366728:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d8cc600/0x6c78c4f8c99650d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f0f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672865.366738:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfc7d8cc600/0x6c78c4f8c99650d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f0f expref: 12 pid: 6506 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672865.366748:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1876607738420992:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672865.367133:0:13184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4a763300 going to sleep for 11 seconds 00000100:00100000:1.0:1789672865.367154:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1876607738420096:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672865.367166:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8cce00/0x6c78c4f8c996510c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9965105 expref: 23 pid: 6504 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672865.367176:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1876607738420224:0@lo:104: 00000100:00100000:1.0:1789672865.367186:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1876607738420352:0@lo:104: 00000100:00100000:3.0:1789672865.367298:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738420736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789672865.367334:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1876607738420480:0@lo:104: 00000100:00100000:0.0:1789672865.367406:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714216960 00000100:00100000:0.0:1789672865.367414:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714216960 00010000:00010000:0.0:1789672865.367445:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9965121 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f4e expref: 13 pid: 6506 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672865.367485:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:0.0:1789672865.367494:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2395:x1876607714216960:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672865.367506:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672865.367511:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9965121 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f4e expref: 13 pid: 6506 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.367522:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9965121 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f4e expref: 13 pid: 6506 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.367537:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8a0000/0x6c78c4f8c9965121 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f4e expref: 13 pid: 6506 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.367549:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672865.367695:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c99650e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99650f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672865.367703:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672865.367714:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c99650e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99650f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672865.367720:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c99650e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99650f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672865.367745:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672865.367747:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672865.367749:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672865.368982:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738421120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789672865.369239:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672865.369822:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672865.369837:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672865.372244:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738420736 00000100:00100000:3.0:1789672865.372259:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738420736 00010000:00010000:3.0:1789672865.372302:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c99650fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99650f7 expref: 23 pid: 6504 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672865.372344:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789672865.372367:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:3637:x1876607738420736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789672865.372382:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672865.372388:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c99650fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99650f7 expref: 23 pid: 6504 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672865.372400:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c99650fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c99650f7 expref: 23 pid: 6504 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672865.372420:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c99650fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c99650f7 expref: 23 pid: 6504 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672865.372437:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672865.372489:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:3637:x1876607738420736:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (3250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672865.372496:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789672865.372541:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738420736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789672865.372954:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672865.373543:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714217088 00000100:00100000:0.0:1789672865.373552:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714217088 00010000:00010000:0.0:1789672865.373580:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d8cc600/0x6c78c4f8c99650d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f0f expref: 13 pid: 6506 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672865.373615:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:0.0:1789672865.373623:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2395:x1876607714217088:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672865.373654:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672865.373680:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d8cc600/0x6c78c4f8c99650d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f0f expref: 13 pid: 6506 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.373702:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d8cc600/0x6c78c4f8c99650d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f0f expref: 13 pid: 6506 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.373719:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672865.373977:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2395:x1876607714217088:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 140us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672865.373987:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:0.0:1789672865.374024:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:2395:x1876607714216960:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 6531us (7794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672865.374103:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:0.0:1789672865.374993:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738420864 00000100:00100000:0.0:1789672865.375003:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738420864 00000100:00100000:0.0:1789672865.375061:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789672865.375070:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:13184:x1876607738420864:12345-0@lo:104: 00010000:00010000:0.0:1789672865.375088:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99650db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99650e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.375169:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789672865.375175:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:13184:x1876607738420864:12345-0@lo:104: Request processed in 107us (8519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672865.375181:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789672865.375239:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1876607738420864:0@lo:104: 00010000:00010000:0.0:1789672865.375255:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8cc600/0x6c78c4f8c99650d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f0f expref: 11 pid: 6506 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672865.375284:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1876607738420992:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789672865.375326:0:13184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c9965144 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672865.375569:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672865.375577:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99650db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99650e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672865.375584:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61608800 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:3.0:1789672865.375589:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99650db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c99650e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672865.375598:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99650db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c99650e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672865.375605:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99650db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c99650e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672865.375618:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789672865.375698:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99650db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99650e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672865.375704:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789672865.375724:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99650db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99650e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672865.375729:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99650db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99650e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672865.375745:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672865.375747:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672865.375749:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672865.376317:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738421248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672865.376371:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672865.376475:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738421248 00000100:00100000:3.0:1789672865.376482:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738421248 00010000:00010000:3.0:1789672865.376507:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99650e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99650db expref: 22 pid: 6506 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672865.376542:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789672865.376550:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:3635:x1876607738421248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789672865.376562:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672865.376567:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99650e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99650db expref: 22 pid: 6506 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672865.376576:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99650e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c99650db expref: 22 pid: 6506 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672865.376591:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99650e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c99650db expref: 22 pid: 6506 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672865.376612:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672865.376698:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3635:x1876607738421248:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672865.376705:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789672865.376998:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738421248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789672865.377473:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672865.377584:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738421120 00000100:00100000:0.0:1789672865.377590:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738421120 00010000:00010000:0.0:1789672865.377612:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c99650f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99650e9 expref: 21 pid: 6506 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672865.377648:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789672865.377676:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc65c2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3638:x1876607738421120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789672865.377696:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672865.377701:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c99650f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99650e9 expref: 21 pid: 6506 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.377710:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c99650f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c99650e9 expref: 21 pid: 6506 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.377723:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c99650f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c99650e9 expref: 21 pid: 6506 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.377738:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c9965144 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.377746:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c9965144 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.377970:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c9965144 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.377991:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c9965144 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.377998:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c9965144 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.378005:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c9965144 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.378012:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61608a00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789672865.378016:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c9965144 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.378024:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c9965144 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.378120:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c9965144 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672865.378133:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672865.378178:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc65c2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:3638:x1876607738421120:12345-0@lo:103:ldlm_bl.0 Request processed in 523us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672865.378185:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:2.0:1789672865.378285:0:13184:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c9965144 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672865.378294:0:13184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c9965144 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672865.378300:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c9965144 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672865.380955:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738421120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789672865.604295:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672865.604320:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738421376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789672865.604392:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672865.604974:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738421376 00000100:00100000:1.0:1789672865.604998:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738421376 00000100:00100000:1.0:1789672865.605062:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789672865.605072:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738421376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789672865.605106:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789672865.605171:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738421376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672865.605178:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789672865.605274:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738421376:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789672865.988877:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672866.512286:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672866.512437:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714217216 00000100:00100000:0.0:1789672866.512447:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714217216 00000100:00100000:0.0:1789672866.512498:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 319 00000100:00100000:0.0:1789672866.512508:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:6171:x1876607714217216:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672866.512537:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672866.512560:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996514b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24f7f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672866.512591:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996514b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f7f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672866.512603:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996514b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f7f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672866.512614:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cc200, rc 0) 00000100:00100000:0.0:1789672866.513085:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:6171:x1876607714217216:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 577us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672866.513093:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 319 00000100:00100000:2.0:1789672866.517262:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672866.517390:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714217344 00000100:00100000:0.0:1789672866.517399:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714217344 00000100:00100000:0.0:1789672866.517477:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 320 00000100:00100000:0.0:1789672866.517487:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:6171:x1876607714217344:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672866.517691:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:6171:x1876607714217344:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 205us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672866.517700:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 320 00000100:00100000:0.0:1789672866.526648:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672866.526717:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714217472 00000100:00100000:0.0:1789672866.526731:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714217472 00000100:00100000:0.0:1789672866.526820:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 321 00000100:00100000:0.0:1789672866.526832:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:6171:x1876607714217472:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672866.526987:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:6171:x1876607714217472:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 Request processed in 157us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672866.526995:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 321 00000100:00100000:0.0:1789672866.534322:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672866.536236:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714217600 00000100:00100000:3.0:1789672866.536249:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714217600 00000100:00100000:3.0:1789672866.536313:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 322 00000100:00100000:3.0:1789672866.536324:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:6171:x1876607714217600:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672866.536343:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672866.536367:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9965152 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24f86 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672866.536392:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9965152 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f86 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672866.536400:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9965152 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f86 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672866.536407:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886200, rc 0) 00000100:00100000:3.0:1789672866.536459:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:6171:x1876607714217600:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 137us (2148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672866.536466:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 322 00000100:00100000:0.0:1789672866.539160:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672866.539304:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714217728 00000100:00100000:2.0:1789672866.539316:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714217728 00000100:00100000:2.0:1789672866.539381:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 323 00000100:00100000:2.0:1789672866.539391:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:6171:x1876607714217728:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.539546:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:6171:x1876607714217728:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 157us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672866.539555:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 323 00000100:00100000:0.0:1789672866.541403:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672866.541548:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714217856 00000100:00100000:3.0:1789672866.541555:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714217856 00000100:00100000:3.0:1789672866.541595:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 324 00000100:00100000:3.0:1789672866.541602:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:6171:x1876607714217856:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672866.541840:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:6171:x1876607714217856:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 Request processed in 236us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672866.541848:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 324 10000000:01000000:2.0:1789672866.823110:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789672866.823118:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfb4676b800 from 7 10000000:01000000:2.0:1789672866.823142:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789672866.823191:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1000/0x6c78c4f8c9965159 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.823204:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1000/0x6c78c4f8c9965159 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.823214:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1000/0x6c78c4f8c9965159 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672866.823242:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738421504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.823408:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672866.823492:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467fb300 going to sleep for 11 seconds 00000100:00100000:3.0:1789672866.823540:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738421504 00000100:00100000:3.0:1789672866.823549:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738421504 00000100:00100000:3.0:1789672866.823871:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789672866.823883:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738421504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672866.823896:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672866.823913:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c9965160 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9965159 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672866.823935:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c9965160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9965159 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672866.823946:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c9965160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9965159 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672866.823953:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887600, rc 0) 00000100:00100000:3.0:1789672866.823994:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738421504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672866.824000:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789672866.824082:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738421504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672866.824097:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1000/0x6c78c4f8c9965159 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965160 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.824106:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1000/0x6c78c4f8c9965159 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9965160 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672866.824166:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738421632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.824193:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672866.824223:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467fb300 going to sleep for 11 seconds 00000100:00100000:0.0:1789672866.824269:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738421632 00000100:00100000:0.0:1789672866.824274:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738421632 00000100:00100000:0.0:1789672866.824311:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789672866.824317:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738421632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672866.824418:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738421632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672866.824425:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789672866.824484:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738421632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.824509:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738421760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.824549:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672866.824569:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467fb300 going to sleep for 11 seconds 00000100:00100000:2.0:1789672866.824582:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738421760 00000100:00100000:2.0:1789672866.824592:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738421760 00000100:00100000:2.0:1789672866.824611:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789672866.824616:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738421760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.824725:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738421760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672866.824731:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789672866.824779:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738421760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789672866.825393:0:13216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789672866.825452:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789672866.825467:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789672866.825476:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1000/0x6c78c4f8c9965159 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965160 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.825488:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1000/0x6c78c4f8c9965159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965160 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672866.825497:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789672866.825501:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc816a3000 from 7 10000000:01000000:2.0:1789672866.825504:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789672866.825530:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9965167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.825538:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9965167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.825547:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9965167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672866.825562:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738421888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.825606:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672866.825633:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467fb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672866.825647:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738421888 00000100:00100000:2.0:1789672866.825651:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738421888 00000100:00100000:2.0:1789672866.825711:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789672866.825718:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738421888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672866.825728:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672866.825739:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8a1a00/0x6c78c4f8c996516e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9965167 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.825757:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8a1a00/0x6c78c4f8c996516e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9965167 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.825767:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8a1a00/0x6c78c4f8c996516e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9965167 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.825776:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a1a00, rc 0) 00000100:00100000:2.0:1789672866.825808:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738421888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672866.825813:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789672866.825845:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738421888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672866.825856:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9965167 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996516e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.825864:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9965167 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996516e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672866.825905:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738422016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.825936:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672866.825955:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467fb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672866.825966:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738422016 00000100:00100000:2.0:1789672866.825969:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738422016 00000100:00100000:2.0:1789672866.825986:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789672866.825990:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738422016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.826084:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738422016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672866.826090:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789672866.826115:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738422016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.826136:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738422144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.826171:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672866.826183:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467fb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672866.826193:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738422144 00000100:00100000:2.0:1789672866.826197:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738422144 00000100:00100000:2.0:1789672866.826213:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789672866.826218:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738422144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.826280:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738422144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672866.826286:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789672866.826319:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738422144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789672866.827021:0:13217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789672866.827070:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789672866.827086:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789672866.827095:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9965167 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996516e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.827115:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9965167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996516e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672866.827124:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789672866.827127:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc7c498000 from 7 10000000:01000000:2.0:1789672866.827129:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789672866.827152:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9965175 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.827159:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9965175 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.827166:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9965175 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672866.827181:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738422272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.827220:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672866.827252:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467fb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672866.827271:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738422272 00000100:00100000:2.0:1789672866.827277:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738422272 00000100:00100000:2.0:1789672866.827302:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789672866.827310:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738422272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672866.827323:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672866.827336:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8a0a00/0x6c78c4f8c996517c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9965175 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.827357:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8a0a00/0x6c78c4f8c996517c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9965175 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.827380:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8a0a00/0x6c78c4f8c996517c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9965175 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.827388:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a0a00, rc 0) 00000100:00100000:2.0:1789672866.827419:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738422272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672866.827425:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789672866.827459:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738422272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672866.827470:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9965175 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996517c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.827478:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9965175 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996517c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672866.827519:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738422400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.827543:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672866.827556:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467fb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672866.827566:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738422400 00000100:00100000:2.0:1789672866.827570:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738422400 00000100:00100000:2.0:1789672866.827586:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789672866.827591:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738422400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.828212:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738422400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 617us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672866.828220:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789672866.828389:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738422400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789672866.828425:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738422528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672866.828478:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672866.828539:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb47be23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672866.828575:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738422528 00000100:00100000:0.0:1789672866.828580:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738422528 00000100:00100000:0.0:1789672866.828645:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789672866.828654:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738422528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672866.828793:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738422528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672866.828911:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789672866.828988:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738422528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789672866.831356:0:13218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789672866.831451:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789672866.831474:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789672866.831486:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9965175 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996517c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.831500:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9965175 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996517c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672866.831512:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789672866.831515:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc44f3d800 from 7 10000000:01000000:2.0:1789672866.831518:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789672866.831563:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0000/0x6c78c4f8c9965183 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.831575:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0000/0x6c78c4f8c9965183 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.831587:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0000/0x6c78c4f8c9965183 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672866.831614:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738422656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.831888:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672866.831977:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467fb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672866.832016:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738422656 00000100:00100000:0.0:1789672866.832024:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738422656 00000100:00100000:0.0:1789672866.832073:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789672866.832083:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738422656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789672866.832097:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672866.832112:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8cda00/0x6c78c4f8c996518a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9965183 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672866.832152:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8cda00/0x6c78c4f8c996518a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9965183 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672866.832161:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8cda00/0x6c78c4f8c996518a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9965183 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672866.832170:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cda00, rc 0) 00000100:00100000:0.0:1789672866.832244:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738422656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672866.832251:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789672866.832388:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738422656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672866.832403:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0000/0x6c78c4f8c9965183 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996518a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.832414:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0000/0x6c78c4f8c9965183 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996518a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672866.832479:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738422784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.832505:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672866.832527:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467fb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672866.832578:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738422784 00000100:00100000:0.0:1789672866.832583:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738422784 00000100:00100000:0.0:1789672866.832615:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789672866.832621:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738422784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672866.832980:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738422784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 357us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672866.832988:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789672866.833052:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738422784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.833080:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738422912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672866.833119:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672866.833180:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467fb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672866.833212:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738422912 00000100:00100000:0.0:1789672866.833217:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738422912 00000100:00100000:0.0:1789672866.833276:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789672866.833284:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738422912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789672866.833380:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738422912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672866.833387:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789672866.834629:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738422912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789672866.836265:0:13219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789672866.836924:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789672866.836958:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789672866.836973:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0000/0x6c78c4f8c9965183 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996518a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672866.836986:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0000/0x6c78c4f8c9965183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996518a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672867.022933:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672867.139897:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738423040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789672867.139980:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672867.140077:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738423040 00000100:00100000:3.0:1789672867.140086:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738423040 00000100:00100000:0.0:1789672867.140279:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738423168:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.140330:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672867.140356:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738423680:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.140382:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672867.140400:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738424192:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.140422:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672867.140446:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789672867.140452:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738423552:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.140477:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672867.140496:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738424064:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.140517:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672867.140533:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738424576:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.140554:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672867.140583:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738423424:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.140606:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672867.140623:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738423936:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.140643:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672867.140696:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876607738424448:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.140719:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672867.140739:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789672867.140745:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738423296:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.140765:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672867.140782:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876607738423808:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.140801:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672867.140819:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876607738424320:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.140847:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672867.140870:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738423168 00000100:00100000:0.0:1789672867.140875:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738423168 00000100:00100000:0.0:1789672867.140924:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789672867.140933:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738423168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.140989:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738423168:12345-0@lo:400:kworker.0 Request processed in 56us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672867.140996:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789672867.141032:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738424192 00000100:00100000:0.0:1789672867.141036:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738424192 00000100:00100000:0.0:1789672867.141063:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738424064 00000100:00100000:0.0:1789672867.141067:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738424064 00000100:00100000:0.0:1789672867.141082:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738424576 00000100:00100000:0.0:1789672867.141085:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738424576 00000100:00100000:0.0:1789672867.141100:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789672867.141107:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47aba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738424192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.141141:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47aba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738424192:12345-0@lo:400:kworker.0 Request processed in 35us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672867.141147:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789672867.141160:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789672867.141166:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738424064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.141191:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738424064:12345-0@lo:400:kworker.0 Request processed in 26us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672867.141197:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789672867.141207:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789672867.141213:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738424576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.141236:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738424576:12345-0@lo:400:kworker.0 Request processed in 24us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672867.141251:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789672867.141272:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738423552 00000100:00100000:0.0:1789672867.141277:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738423552 00000100:00100000:0.0:1789672867.141295:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738423936 00000100:00100000:0.0:1789672867.141297:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738423936 00000100:00100000:0.0:1789672867.141309:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738424448 00000100:00100000:0.0:1789672867.141312:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738424448 00000100:00100000:0.0:1789672867.141323:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738423296 00000100:00100000:0.0:1789672867.141325:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738423296 00000100:00100000:0.0:1789672867.141339:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738423808 00000100:00100000:0.0:1789672867.141342:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738423808 00000100:00100000:0.0:1789672867.141353:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738424320 00000100:00100000:0.0:1789672867.141355:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738424320 00000100:00100000:0.0:1789672867.141368:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789672867.141374:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738423552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.141404:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738423552:12345-0@lo:400:kworker.0 Request processed in 30us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672867.141410:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789672867.141421:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789672867.141427:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738423936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.141459:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738423936:12345-0@lo:400:kworker.0 Request processed in 32us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672867.141464:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789672867.141475:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789672867.141480:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876607738424448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.141505:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876607738424448:12345-0@lo:400:kworker.0 Request processed in 25us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672867.141511:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789672867.141528:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789672867.141534:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738423296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.141561:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738423296:12345-0@lo:400:kworker.0 Request processed in 28us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672867.141567:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789672867.141577:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789672867.141583:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876607738423808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.141606:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876607738423808:12345-0@lo:400:kworker.0 Request processed in 23us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672867.141611:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789672867.141623:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789672867.141628:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876607738424320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.141773:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876607738424320:12345-0@lo:400:kworker.0 Request processed in 143us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672867.141779:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789672867.141804:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738423680 00000100:00100000:0.0:1789672867.141808:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738423680 00000100:00100000:0.0:1789672867.141830:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738423424 00000100:00100000:0.0:1789672867.141834:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738423424 00000100:00100000:0.0:1789672867.141846:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789672867.141852:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738423680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.141886:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738423680:12345-0@lo:400:kworker.0 Request processed in 34us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672867.141892:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789672867.141904:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789672867.141909:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738423424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.141947:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738423424:12345-0@lo:400:kworker.0 Request processed in 38us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672867.141952:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789672867.142023:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738423296:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.142036:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876607738423808:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.142046:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876607738424320:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.142056:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738423424:0@lo:400:kworker.0 00010000:00080000:0.0:1789672867.142069:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb46803800 x1876607738423936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672867.142082:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738423936:0@lo:400:kworker.0 00010000:00080000:0.0:1789672867.142092:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47abb480 x1876607738424448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672867.142101:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876607738424448:0@lo:400:kworker.0 00000100:00100000:3.0:1789672867.142251:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789672867.142261:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738423040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789672867.142288:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672867.142323:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738423040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (2344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672867.142330:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1789672867.142351:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789672867.142357:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789672867.142362:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789672867.142364:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789672867.142411:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc4121a680 x1876607738423040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672867.142429:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738423040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789672867.142917:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738423552:0@lo:400:kworker.0 00010000:00080000:0.0:1789672867.142932:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47ab8000 x1876607738424064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672867.142941:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738424064:0@lo:400:kworker.0 00010000:00080000:0.0:1789672867.142953:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47ab9180 x1876607738424576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672867.142961:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738424576:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.142970:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738423168:0@lo:400:kworker.0 00000100:00100000:0.0:1789672867.142996:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738423680:0@lo:400:kworker.0 00010000:00080000:0.0:1789672867.143010:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47abad80 x1876607738424192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672867.143017:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738424192:0@lo:400:kworker.0 00000100:00100000:2.0:1789672867.150612:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738424704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672867.150725:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672867.150838:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738424704 00000100:00100000:1.0:1789672867.150847:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738424704 00000100:00100000:1.0:1789672867.150904:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789672867.150915:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738424704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789672867.150938:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672867.150983:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738424704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672867.150990:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:2.0:1789672867.151149:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d9f3100 x1876607738424704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672867.151168:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738424704:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789672868.035966:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672868.676209:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738424832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672868.676321:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672868.676463:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738424832 00000100:00100000:1.0:1789672868.676472:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738424832 00000100:00100000:1.0:1789672868.676543:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789672868.676554:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738424832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672868.676582:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672868.676650:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738424832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672868.676675:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:1.0:1789672868.676728:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d9f3b80 x1876607738424832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672868.676746:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738424832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672868.682282:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672868.682317:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738424960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789672868.682385:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672868.682460:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738424960 00000100:00100000:2.0:1789672868.682468:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738424960 00000100:00100000:2.0:1789672868.682514:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789672868.682523:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738424960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789672868.682546:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672868.682590:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738424960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672868.682596:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1789672868.682681:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47905880 x1876607738424960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672868.682698:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738424960:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789672869.063474:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789672869.244240:0:13384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789672869.700711:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738425088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789672869.703196:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672869.703950:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738425088 00000100:00100000:1.0:1789672869.703962:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738425088 00000100:00100000:1.0:1789672869.704021:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789672869.704032:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738425088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789672869.704069:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789672869.704165:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738425088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672869.704173:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789672869.704268:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738425088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672869.845285:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672869.845343:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672869.845383:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672869.845401:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672869.845435:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672869.845725:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714217984 00000100:00100000:2.0:1789672869.845736:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714217984 00000100:00100000:2.0:1789672869.845809:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 338 00000100:00100000:2.0:1789672869.845820:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714217984:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672869.845903:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714217984:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 84us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672869.845911:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 338 00000100:00100000:0.0:1789672869.846290:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714218112 00000100:00100000:0.0:1789672869.846296:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714218112 00000100:00100000:0.0:1789672869.846353:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714218240 00000100:00100000:0.0:1789672869.846357:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714218240 00000100:00100000:0.0:1789672869.846372:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714218496 00000100:00100000:0.0:1789672869.846374:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714218496 00000100:00100000:0.0:1789672869.846387:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714218368 00000100:00100000:0.0:1789672869.846390:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714218368 00000100:00100000:0.0:1789672869.846403:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 212 00000100:00100000:0.0:1789672869.846410:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714218112:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672869.846459:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714218112:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 49us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672869.846466:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 212 00000100:00100000:0.0:1789672869.846479:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 213 00000100:00100000:0.0:1789672869.846485:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714218240:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672869.846510:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714218240:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 26us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672869.846516:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 213 00000100:00100000:0.0:1789672869.846539:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 214 00000100:00100000:0.0:1789672869.846561:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714218496:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672869.846588:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714218496:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 29us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672869.846594:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 214 00000100:00100000:0.0:1789672869.846618:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 215 00000100:00100000:0.0:1789672869.846625:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714218368:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672869.846650:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714218368:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672869.846708:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 215 00000100:00080000:2.0:1789672869.847267:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789672869.847272:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789672870.092258:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672870.725879:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789672870.725914:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738425216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789672870.725997:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672870.726054:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738425216 00000100:00100000:0.0:1789672870.726064:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738425216 00000100:00100000:0.0:1789672870.726320:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789672870.726335:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738425216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789672870.726377:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789672870.726438:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738425216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672870.726444:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789672870.726495:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738425216:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789672871.112866:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672872.136107:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672872.260062:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738425344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789672872.260433:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672872.260509:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672872.260516:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738425472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672872.260592:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672872.260679:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738425344 00000100:00100000:3.0:1789672872.260690:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738425344 00000100:00100000:3.0:1789672872.260743:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738425472 00000100:00100000:3.0:1789672872.260747:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738425472 00000100:00100000:3.0:1789672872.260765:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789672872.260775:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738425344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789672872.260812:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672872.260864:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738425344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672872.260872:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789672872.260889:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789672872.260896:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738425472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789672872.260906:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672872.260930:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738425472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672872.260936:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1789672872.260951:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789672872.260994:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc41219c00 x1876607738425472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672872.261020:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738425472:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789672872.261033:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc41219f80 x1876607738425344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672872.261045:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738425344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789672872.261635:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738425856:0@lo:400:kworker.0 00000100:00100000:0.0:1789672872.261713:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672872.261771:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738425600:0@lo:400:kworker.0 00000100:00100000:1.0:1789672872.261806:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672872.261835:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789672872.261840:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738425728:0@lo:400:kworker.0 00000100:00100000:1.0:1789672872.261866:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672872.261897:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738425728 00000100:00100000:1.0:1789672872.261902:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738425728 00000100:00100000:1.0:1789672872.261936:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789672872.261943:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738425728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672872.261994:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738425728:12345-0@lo:400:kworker.0 Request processed in 51us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672872.262001:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789672872.262033:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738425728:0@lo:400:kworker.0 00000100:00100000:1.0:1789672872.262078:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738425856 00000100:00100000:1.0:1789672872.262082:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738425856 00000100:00100000:1.0:1789672872.262120:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789672872.262127:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738425856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672872.262265:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738425984:0@lo:400:kworker.0 00000100:00100000:3.0:1789672872.262294:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672872.262334:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738425984 00000100:00100000:3.0:1789672872.262338:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738425984 00000100:00100000:3.0:1789672872.262361:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789672872.262368:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738425984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672872.262402:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738425984:12345-0@lo:400:kworker.0 Request processed in 34us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672872.262408:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789672872.262426:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738425600 00000100:00100000:3.0:1789672872.262429:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738425600 00000100:00100000:3.0:1789672872.262452:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789672872.262458:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738425600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672872.262490:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3637:x1876607738425600:12345-0@lo:400:kworker.0 Request processed in 32us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672872.262496:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789672872.262527:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738425984:0@lo:400:kworker.0 00000100:00100000:3.0:1789672872.262588:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738425600:0@lo:400:kworker.0 00000100:00100000:1.0:1789672872.266544:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738425856:12345-0@lo:400:kworker.0 Request processed in 4407us (4819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672872.266569:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789672872.269647:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738425856:0@lo:400:kworker.0 00000100:00100000:3.0:1789672872.272513:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738426112:0@lo:400:kworker.0 00000100:00100000:3.0:1789672872.272601:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672872.272684:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738426112 00000100:00100000:0.0:1789672872.272693:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738426112 00000100:00100000:0.0:1789672872.272765:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789672872.272776:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738426112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672872.273616:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738426240:0@lo:400:kworker.0 00000100:00100000:1.0:1789672872.273676:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672872.273720:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738426240 00000100:00100000:1.0:1789672872.273726:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738426240 00000100:00100000:1.0:1789672872.273771:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789672872.273779:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738426240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672872.273821:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738426240:12345-0@lo:400:kworker.0 Request processed in 43us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672872.273828:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:1.0:1789672872.273850:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672872.273881:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738426240:0@lo:400:kworker.0 00000100:00100000:0.0:1789672872.274965:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738426112:12345-0@lo:400:kworker.0 Request processed in 2186us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672872.274991:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789672872.275166:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672872.275235:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672872.275248:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738426496:0@lo:400:kworker.0 00000100:00100000:0.0:1789672872.275333:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672872.275369:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738426496 00000100:00100000:0.0:1789672872.275375:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738426496 00000100:00100000:0.0:1789672872.275419:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789672872.275427:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738426496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672872.275469:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738426496:12345-0@lo:400:kworker.0 Request processed in 44us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672872.275476:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1789672872.275494:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789672872.275519:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb477a1180 x1876607738426496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672872.275532:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738426496:0@lo:400:kworker.0 00000100:00100000:1.0:1789672872.275847:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738426368:0@lo:400:kworker.0 00000100:00100000:1.0:1789672872.275880:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672872.275965:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738426368 00000100:00100000:0.0:1789672872.275970:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738426368 00000100:00100000:0.0:1789672872.276014:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789672872.276022:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738426368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672872.276059:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738426368:12345-0@lo:400:kworker.0 Request processed in 38us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672872.276077:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:1.0:1789672872.276461:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789672872.276484:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb477a1500 x1876607738426368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672872.276496:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738426368:0@lo:400:kworker.0 00000100:00100000:3.0:1789672872.276588:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738426112:0@lo:400:kworker.0 00000100:00100000:3.0:1789672872.276829:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738426624:0@lo:400:kworker.0 00000100:00100000:3.0:1789672872.276866:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672872.276926:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738426624 00000100:00100000:0.0:1789672872.276931:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738426624 00000100:00100000:0.0:1789672872.276977:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789672872.276985:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738426624:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789672872.277054:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672872.277156:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738426752:0@lo:400:kworker.0 00000100:00100000:1.0:1789672872.277186:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672872.277239:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738426752 00000100:00100000:1.0:1789672872.277243:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738426752 00000100:00100000:1.0:1789672872.277277:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789672872.277284:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738426752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672872.277320:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738426752:12345-0@lo:400:kworker.0 Request processed in 37us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672872.277327:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:1.0:1789672872.277345:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672872.277365:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738426752:0@lo:400:kworker.0 00000100:00100000:0.0:1789672872.277778:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738426624:12345-0@lo:400:kworker.0 Request processed in 793us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672872.277786:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1789672872.277901:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb477a1880 x1876607738426624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672872.277919:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738426624:0@lo:400:kworker.0 00000100:00100000:0.0:1789672872.278060:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738426880:0@lo:400:kworker.0 00000100:00100000:0.0:1789672872.278092:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672872.278433:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738426880 00000100:00100000:1.0:1789672872.278440:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738426880 00000100:00100000:1.0:1789672872.278525:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789672872.278534:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738426880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672872.278595:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738426880:12345-0@lo:400:kworker.0 Request processed in 63us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672872.278602:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00010000:00080000:3.0:1789672872.278685:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb477a0380 x1876607738426880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672872.278696:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738426880:0@lo:400:kworker.0 00000100:00080000:2.0:1789672872.278785:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789672873.161866:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672873.795856:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672873.795883:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738427008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789672873.795951:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672873.795965:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738427136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672873.796004:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672873.796068:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672873.796207:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738427008 00000100:00100000:3.0:1789672873.796215:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738427008 00000100:00100000:2.0:1789672873.796299:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738427136 00000100:00100000:2.0:1789672873.796304:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738427136 00000100:00100000:3.0:1789672873.796309:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789672873.796318:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738427008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789672873.796354:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672873.796426:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738427008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672873.796435:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789672873.796451:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789672873.796457:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738427136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672873.796467:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672873.796497:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738427136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672873.796503:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1789672873.796590:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb477a0700 x1876607738427008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672873.796612:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738427008:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789672873.796685:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462e8700 x1876607738427136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672873.796696:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738427136:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789672874.180115:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672874.825937:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738427264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672874.826030:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672874.826121:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738427264 00000100:00100000:1.0:1789672874.826129:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738427264 00000100:00100000:1.0:1789672874.826172:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789672874.826181:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738427264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789672874.826214:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789672874.826261:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738427264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672874.826268:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789672874.826310:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738427264:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1789672874.948828:0:13534:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 15:21:12 (1789672872) === 00000100:00100000:1.0:1789672874.963206:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672874.963245:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672874.963503:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672874.963537:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672874.963574:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672874.963740:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714218624 00000100:00100000:1.0:1789672874.963751:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714218624 00000100:00100000:1.0:1789672874.963807:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 340 00000100:00100000:1.0:1789672874.963827:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2395:x1876607714218624:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672874.963914:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2395:x1876607714218624:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 89us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672874.963922:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 340 00000100:00100000:1.0:1789672874.963955:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714218880 00000100:00100000:1.0:1789672874.963959:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714218880 00000100:00100000:1.0:1789672874.964000:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714219136 00000100:00100000:1.0:1789672874.964003:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714219136 00000100:00100000:1.0:1789672874.964015:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714218752 00000100:00100000:1.0:1789672874.964017:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714218752 00000100:00100000:1.0:1789672874.964028:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714219008 00000100:00100000:1.0:1789672874.964030:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714219008 00000100:00100000:1.0:1789672874.964043:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 222 00000100:00100000:1.0:1789672874.964050:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2395:x1876607714218880:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672874.964077:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2395:x1876607714218880:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 28us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672874.964083:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 222 00000100:00100000:1.0:1789672874.964094:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 223 00000100:00100000:1.0:1789672874.964100:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2395:x1876607714219136:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672874.964122:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2395:x1876607714219136:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 22us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672874.964128:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 223 00000100:00100000:1.0:1789672874.964139:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 224 00000100:00100000:1.0:1789672874.964145:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2395:x1876607714218752:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672874.964169:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2395:x1876607714218752:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672874.964180:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 224 00000100:00100000:1.0:1789672874.964194:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 225 00000100:00100000:1.0:1789672874.964199:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2395:x1876607714219008:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672874.964220:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2395:x1876607714219008:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 21us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672874.964225:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 225 00000100:00080000:0.0:1789672874.966881:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672874.966892:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789672875.153326:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672875.153378:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672875.153450:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714219264 00000100:00100000:1.0:1789672875.153465:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714219264 00000100:00100000:2.0:1789672875.153527:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714219392 00000100:00100000:2.0:1789672875.153534:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714219392 00000100:00100000:1.0:1789672875.153558:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:2.0:1789672875.153575:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:1.0:1789672875.153575:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2398:x1876607714219264:12345-192.168.201.50@tcp:41:mkdir.0 00000100:00100000:2.0:1789672875.153586:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:10511:x1876607714219392:12345-192.168.201.50@tcp:700:mkdir.0 00000100:00100000:2.0:1789672875.153682:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:10511:x1876607714219392:12345-192.168.201.50@tcp:700:mkdir.0 Request processed in 99us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672875.153688:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 2 00000004:00000024:1.0:1789672875.156361:0:9524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789672875.156522:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714219264:12345-192.168.201.50@tcp:41:mkdir.0 Request processed in 2939us (3194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672875.156536:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:0.0:1789672875.160320:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672875.160486:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714219648 00000100:00100000:1.0:1789672875.160499:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714219648 00000100:00100000:1.0:1789672875.160631:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:1.0:1789672875.160644:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:10511:x1876607714219648:12345-192.168.201.50@tcp:36:mkdir.0 00010000:00010000:1.0:1789672875.160748:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672875.160816:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c9965033 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24efa expref: 6 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.160850:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc821d4300) 00010000:00010000:1.0:1789672875.160864:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672875.160994:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965191 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161011:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965191 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161023:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965191 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161037:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965198 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161045:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965198 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161051:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965198 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161756:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996519f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161773:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996519f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161784:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996519f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789672875.161804:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db76249b reply state 000000002ec7731f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996519f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161817:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996519f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161825:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672875.161835:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789672875.161839:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789672875.161847:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789672875.161858:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965191 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161866:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965191 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161874:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965191 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161880:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61609c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672875.161886:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965191 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161895:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965191 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161908:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc821d4800) 00010000:00010000:1.0:1789672875.161910:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672875.161915:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965191 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161921:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965191 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789672875.161940:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db76249b reply state 000000002ec7731f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965198 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161948:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965198 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.161965:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cfc821d4100) 00010000:00010000:1.0:1789672875.161968:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789672875.161969:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789672875.162110:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:10511:x1876607714219648:12345-192.168.201.50@tcp:36:mkdir.0 Request processed in 1464us (1799us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789672875.162122:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:2.0:1789672875.177388:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672875.178010:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714219776 00000100:00100000:1.0:1789672875.178033:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714219776 00000100:00100000:2.0:1789672875.178559:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:2.0:1789672875.178582:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:10512:x1876607714219776:12345-192.168.201.50@tcp:101:chmod.0 00010000:00010000:2.0:1789672875.178926:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672875.178977:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefa00/0x6c78c4f8c99651a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24f8d expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.179112:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c99651ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.179133:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c99651ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.179156:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c99651ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672875.179272:0:11081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789672875.179280:0:11081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789672875.179347:0:11081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c99651ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.179393:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefa00/0x6c78c4f8c99651a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f8d expref: 9 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.179426:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c99651ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f8d expref: 8 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.179440:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc4990a700) 00010000:00010000:2.0:1789672875.179445:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789672875.179451:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee800, rc 0) 00000100:00100000:2.0:1789672875.179581:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:10512:x1876607714219776:12345-192.168.201.50@tcp:101:chmod.0 Request processed in 1006us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672875.180551:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:0.0:1789672875.184078:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672875.184232:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714220032 00000100:00100000:1.0:1789672875.184243:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714220032 00000100:00100000:1.0:1789672875.184334:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:1.0:1789672875.184347:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:10512:x1876607714220032:12345-192.168.201.50@tcp:36:chmod.0 00010000:00010000:1.0:1789672875.184409:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672875.184438:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c99651ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f8d expref: 8 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.184459:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc4990a700) 00010000:00010000:1.0:1789672875.184471:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672875.184499:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c99651b4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.184526:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c99651b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.184537:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c99651b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789672875.184768:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e64d011 reply state 0000000003e91127 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c99651b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.184788:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c99651b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.184795:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc821d4800) 00010000:00010000:1.0:1789672875.184798:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789672875.184800:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789672875.184807:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789672875.184901:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:10512:x1876607714220032:12345-192.168.201.50@tcp:36:chmod.0 Request processed in 557us (835us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789672875.184909:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 25 00010000:00010000:2.0:1789672875.210379:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672875.214225:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672875.215001:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714220160 00000100:00100000:1.0:1789672875.215020:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714220160 00000100:00100000:1.0:1789672875.215102:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:1.0:1789672875.215119:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:10513:x1876607714220160:12345-192.168.201.50@tcp:101:chown.0 00010000:00010000:1.0:1789672875.215154:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672875.215183:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c99651bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24f94 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.215276:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608800/0x6c78c4f8c99651c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.215295:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608800/0x6c78c4f8c99651c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.215310:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608800/0x6c78c4f8c99651c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672875.215371:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789672875.215375:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789672875.215449:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608800/0x6c78c4f8c99651c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.215498:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c99651bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f94 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.215636:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608800/0x6c78c4f8c99651c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f94 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.215654:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc821d4800) 00010000:00010000:1.0:1789672875.215810:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672875.215818:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc61608800, rc 0) 00000100:00100000:0.0:1789672875.215967:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+10:10513:x1876607714220160:12345-192.168.201.50@tcp:101:chown.0 Request processed in 843us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672875.215981:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:3.0:1789672875.219325:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672875.219441:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714220288 00000100:00100000:2.0:1789672875.219457:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714220288 00000100:00100000:2.0:1789672875.219553:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:2.0:1789672875.219566:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+10:10513:x1876607714220288:12345-192.168.201.50@tcp:101:chown.0 00010000:00010000:2.0:1789672875.219602:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672875.219632:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefa00/0x6c78c4f8c99651c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24f9b expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.219748:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99651d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.219782:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99651d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.219795:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99651d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.219808:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99651d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.219816:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99651d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.219825:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99651d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220044:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c99651de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220061:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c99651de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220092:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c99651de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672875.220157:0:11081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789672875.220162:0:11081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789672875.220191:0:11081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c99651de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220206:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99651d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220214:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99651d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220223:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99651d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220230:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aeec00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672875.220236:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99651d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220245:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99651d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220259:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc821d4800) 00010000:00010000:3.0:1789672875.220263:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672875.220269:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99651d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220276:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99651d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220302:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99651d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220309:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99651d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220315:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99651d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220321:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aee200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672875.220324:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99651d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220331:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99651d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220340:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cfc821d4100) 00010000:00010000:3.0:1789672875.220342:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672875.220345:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99651d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220352:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99651d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220390:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefa00/0x6c78c4f8c99651c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f9b expref: 12 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220407:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c99651de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f9b expref: 11 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.220426:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:3.0:1789672875.220428:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789672875.220431:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886000, rc 0) 00000100:00100000:3.0:1789672875.221114:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+11:10513:x1876607714220288:12345-192.168.201.50@tcp:101:chown.0 Request processed in 1544us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672875.221126:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:0.0:1789672875.224987:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672875.225079:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714220416 00000100:00100000:3.0:1789672875.225094:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714220416 00000100:00100000:3.0:1789672875.225173:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:3.0:1789672875.225187:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+11:10513:x1876607714220416:12345-192.168.201.50@tcp:900:chown.0 00000100:00100000:3.0:1789672875.225309:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+11:10513:x1876607714220416:12345-192.168.201.50@tcp:900:chown.0 Request processed in 124us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672875.225317:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:0.0:1789672875.233001:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672875.233240:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714220672 00000100:00100000:1.0:1789672875.233256:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714220672 00000100:00100000:1.0:1789672875.233342:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:1.0:1789672875.233355:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+11:10513:x1876607714220672:12345-192.168.201.50@tcp:36:chown.0 00010000:00010000:1.0:1789672875.233435:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672875.233481:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c99651de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f9b expref: 11 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.233938:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672875.233947:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672875.233982:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c99651e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.233999:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c99651e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.234011:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c99651e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789672875.248813:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:1.0:1789672875.248946:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a63594f reply state 00000000852488cf transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c99651e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.248971:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c99651e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.248981:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672875.248984:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789672875.248989:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789672875.249010:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1789672875.249115:0:9524:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789672875.249140:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:10513:x1876607714220672:12345-192.168.201.50@tcp:36:chown.0 Request processed in 15783us (16149us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789672875.249150:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 28 00010000:00010000:3.0:1789672875.249760:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c99651e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.249771:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c99651e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.249779:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c99651e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.249785:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61609600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672875.249789:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c99651e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.249811:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c99651e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.249823:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:3.0:1789672875.249825:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789672875.249829:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c99651e5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.249835:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609600/0x6c78c4f8c99651e5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.249924:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965198 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.249943:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965198 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.249949:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965198 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.249954:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61608e00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672875.249957:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965198 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.249964:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965198 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.249985:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cfc821d4100) 00010000:00010000:2.0:1789672875.249987:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672875.249990:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965198 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.250008:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965198 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.250023:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996519f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.250029:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996519f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.250035:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996519f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.250040:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61608a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672875.250043:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996519f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.250048:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996519f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.250057:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:2.0:1789672875.250059:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672875.250062:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996519f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.250068:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996519f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.250092:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c99651b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.250098:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c99651b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.250104:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c99651b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.250109:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61609c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672875.250112:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c99651b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.250118:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c99651b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.250124:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc821d4800) 00010000:00010000:2.0:1789672875.250126:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789672875.250129:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c99651b4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.250134:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c99651b4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672875.266395:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672875.266492:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714220800 00000100:00100000:0.0:1789672875.266502:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714220800 00000100:00100000:0.0:1789672875.266579:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:0.0:1789672875.266590:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:10514:x1876607714220800:12345-192.168.201.50@tcp:101:touch.500 00010000:00010000:0.0:1789672875.266616:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672875.266694:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c99651ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24fa2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789672875.267738:0:6514:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 967us 00010000:00010000:2.0:1789672875.282903:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c99651f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.282931:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c99651f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.282958:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c99651f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.282978:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99651fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.282986:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99651fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.282992:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99651fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283125:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965201 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283134:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283146:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672875.283178:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789672875.283182:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789672875.283225:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965201 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283237:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c99651f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283244:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c99651f3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283260:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c99651f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283266:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aef600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672875.283271:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c99651f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283279:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c99651f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283291:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc821d4800) 00010000:00010000:2.0:1789672875.283294:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672875.283299:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c99651f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283305:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c99651f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283316:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99651fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283323:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99651fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283328:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99651fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283332:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aee600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672875.283334:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99651fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283351:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99651fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283359:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cfc4990a800) 00010000:00010000:2.0:1789672875.283361:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672875.283364:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99651fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283370:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99651fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283415:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c99651ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fa2 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283429:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965201 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fa2 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.283436:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cfc4990a300) 00010000:00010000:2.0:1789672875.283438:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789672875.283440:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aefc00, rc 0) 00000100:00100000:2.0:1789672875.283547:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:10514:x1876607714220800:12345-192.168.201.50@tcp:101:touch.500 Request processed in 16957us (17161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672875.283556:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:0.0:1789672875.287630:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672875.288004:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714221056 00000100:00100000:3.0:1789672875.288016:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714221056 00000100:00100000:3.0:1789672875.288111:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:3.0:1789672875.288122:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:10514:x1876607714221056:12345-192.168.201.50@tcp:101:touch.500 00010000:00010000:3.0:1789672875.288142:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672875.288163:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965208 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24fa9 expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.288276:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996520f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.288290:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996520f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.288301:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996520f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.288350:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965216 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.288370:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.288377:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789672875.288816:0:11081:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789672875.289031:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996521d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.289041:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996521d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.289048:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996521d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.289081:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996520f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.289089:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996520f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.289096:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996520f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.289101:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672875.289106:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996520f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.289113:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996520f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.289135:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cfc4990a300) 00010000:00010000:3.0:1789672875.289137:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672875.289142:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996520f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.289148:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996520f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672875.289159:0:11081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c88c54ba reply state 00000000ecd005cf transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.289171:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965216 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.289177:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x53e8e04c (ffff8cfb419b1100) 00010000:00010000:3.0:1789672875.289179:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789672875.289181:0:11081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789672875.289210:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965208 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fa9 expref: 10 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.289225:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996521d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fa9 expref: 9 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.289231:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cfb419b1f00) 00010000:00010000:3.0:1789672875.289233:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672875.289236:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886000, rc 0) 00000100:00100000:3.0:1789672875.289358:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+10:10514:x1876607714221056:12345-192.168.201.50@tcp:101:touch.500 Request processed in 1237us (1737us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789672875.289366:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:0.0:1789672875.300955:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672875.305135:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714221312 00000100:00100000:1.0:1789672875.305160:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714221312 00000100:00100000:1.0:1789672875.305245:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:0.0:1789672875.305747:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+10:10514:x1876607714221312:12345-192.168.201.50@tcp:36:touch.500 00010000:00010000:0.0:1789672875.305813:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672875.305846:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996521d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fa9 expref: 10 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672875.305865:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cfb419b1f00) 00010000:00010000:0.0:1789672875.305880:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672875.305942:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c996522b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672875.305956:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c996522b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672875.305966:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c996522b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789672875.306088:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006abdccca reply state 000000000d436012 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c996522b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672875.306099:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c996522b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672875.306104:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cfc4afc7400) 00010000:00010000:0.0:1789672875.306106:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789672875.306123:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789672875.306215:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+11:10514:x1876607714221312:12345-192.168.201.50@tcp:36:touch.500 Request processed in 962us (5274us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789672875.306221:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:2.0:1789672875.311439:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672875.311549:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714221440 00000100:00100000:0.0:1789672875.311560:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714221440 00000100:00100000:0.0:1789672875.311721:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:0.0:1789672875.311733:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+11:10514:x1876607714221440:12345-192.168.201.50@tcp:101:touch.500 00010000:00010000:0.0:1789672875.311757:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672875.311779:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c9965232 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24fb0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672875.311846:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c9965232 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fb0 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672875.311861:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c9965232 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fb0 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672875.311883:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cfc4afc7400) 00010000:00010000:0.0:1789672875.311886:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789672875.311891:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cd400, rc 0) 00000100:00100000:0.0:1789672875.311961:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+12:10514:x1876607714221440:12345-192.168.201.50@tcp:101:touch.500 Request processed in 230us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672875.311968:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:2.0:1789672875.316243:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672875.316737:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714221568 00000100:00100000:0.0:1789672875.316749:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714221568 00000100:00100000:0.0:1789672875.316809:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:0.0:1789672875.316817:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1876607714221568:12345-192.168.201.50@tcp:8:touch.500 00010000:00080000:0.0:1789672875.316862:0:8494:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp t0 exp 0000000000000000 cur 353 last 0 00000020:00000080:0.0:1789672875.316893:0:8494:0:(genops.c:1384:class_connect()) connect: client ad795a16-0aa4-4e04-82a0-6f12aab5f2ea, cookie 0x6c78c4f8c9965239 00002000:00100000:0.0:1789672875.316904:0:8494:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ad795a16-0aa4-4e04-82a0-6f12aab5f2ea/ffff8cfb47a6a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789672875.316919:0:8494:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789672875.316997:0:8494:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789672875.317025:0:8494:0:(import.c:65:import_set_state_nolock()) ffff8cfb47a6d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789672875.317092:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2394:x1876607714221568:12345-192.168.201.50@tcp:8:touch.500 Request processed in 275us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672875.317098:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:2.0:1789672875.322581:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672875.322744:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714221696 00000100:00100000:1.0:1789672875.322757:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714221696 00000100:00100000:1.0:1789672875.322845:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:1.0:1789672875.322858:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:0:x1876607714221696:12345-192.168.201.50@tcp:2:touch.500 00000100:00080000:0.0:1789672875.328324:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789672875.330730:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:2.0:1789672875.330745:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000100:00100000:1.0:1789672875.330958:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:0:x1876607714221696:12345-192.168.201.50@tcp:2:touch.500 Request processed in 8097us (8384us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789672875.330970:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:3.0:1789672875.338292:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672875.338402:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714221952 00000100:00100000:1.0:1789672875.338413:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714221952 00000100:00100000:1.0:1789672875.338476:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:1.0:1789672875.338486:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+12:10514:x1876607714221952:12345-192.168.201.50@tcp:35:touch.500 00000100:00100000:2.0:1789672875.339108:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+13:10514:x1876607714221952:12345-192.168.201.50@tcp:35:touch.500 Request processed in 622us (826us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789672875.339117:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:2.0:1789672875.353199:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672875.354193:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714222080 00000100:00100000:3.0:1789672875.354208:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714222080 00000100:00100000:3.0:1789672875.354279:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:3.0:1789672875.354291:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+13:10515:x1876607714222080:12345-192.168.201.50@tcp:101:rm.0 00010000:00010000:3.0:1789672875.354316:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672875.354339:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965240 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24fb7 expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.354475:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965247 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.354492:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.354517:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672875.354572:0:11081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789672875.354576:0:11081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789672875.354859:0:11081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.354889:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965240 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fb7 expref: 15 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.354909:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965247 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fb7 expref: 14 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.354918:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cfc4990a300) 00010000:00010000:3.0:1789672875.355008:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789672875.355013:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887200, rc 0) 00000100:00100000:3.0:1789672875.355085:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+14:10515:x1876607714222080:12345-192.168.201.50@tcp:101:rm.0 Request processed in 796us (1898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672875.355093:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:0.0:1789672875.363163:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672875.363304:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714222336 00000100:00100000:2.0:1789672875.363315:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714222336 00000100:00100000:2.0:1789672875.363368:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:2.0:1789672875.363378:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+14:10515:x1876607714222336:12345-192.168.201.50@tcp:101:rm.0 00010000:00010000:2.0:1789672875.363399:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672875.363419:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c996524e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24fbe expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672875.363533:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789672875.363642:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c996524e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fbe expref: 16 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.363682:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc821d4800) 00010000:00010000:2.0:1789672875.363686:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789672875.363692:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c996524e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fbe expref: 16 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.363705:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee800, rc 0) 00000100:00100000:2.0:1789672875.363769:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+15:10515:x1876607714222336:12345-192.168.201.50@tcp:101:rm.0 Request processed in 392us (617us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1789672875.363777:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:2.0:1789672875.373212:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672875.373414:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714222464 00000100:00100000:3.0:1789672875.373426:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714222464 00000100:00100000:3.0:1789672875.373488:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:3.0:1789672875.373499:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+15:10515:x1876607714222464:12345-192.168.201.50@tcp:37:rm.0 00000100:00100000:2.0:1789672875.388126:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+15:10515:x1876607714222464:12345-192.168.201.50@tcp:37:rm.0 Request processed in 14617us (14912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672875.388177:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:0.0:1789672875.396472:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672875.396588:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714222720 00000100:00100000:2.0:1789672875.396602:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714222720 00000100:00100000:2.0:1789672875.396720:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:2.0:1789672875.396733:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f854850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+15:10515:x1876607714222720:12345-192.168.201.50@tcp:35:rm.0 00000100:00100000:2.0:1789672875.397023:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f854850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+16:10515:x1876607714222720:12345-192.168.201.50@tcp:35:rm.0 Request processed in 292us (565us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789672875.397031:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:3.0:1789672875.407086:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672875.416941:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714222976 00000100:00100000:0.0:1789672875.416966:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714222976 00000100:00100000:0.0:1789672875.417075:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:0.0:1789672875.417090:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+16:10515:x1876607714222976:12345-192.168.201.50@tcp:101:rm.0 00010000:00010000:0.0:1789672875.417125:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672875.417154:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996525c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24fc5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672875.417301:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965263 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672875.417321:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965263 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672875.417335:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965263 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672875.417368:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789672875.417526:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996525c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fc5 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672875.417549:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965263 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fc5 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672875.417559:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cfc4990a300) 00010000:00010000:0.0:1789672875.417562:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789672875.417567:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cc800, rc 0) 00000100:00100000:0.0:1789672875.419631:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+18:10515:x1876607714222976:12345-192.168.201.50@tcp:101:rm.0 Request processed in 2530us (12545us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789672875.419648:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:1.0:1789672875.430108:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672875.430220:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714223104 00000100:00100000:3.0:1789672875.430233:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714223104 00000100:00100000:3.0:1789672875.430304:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:3.0:1789672875.430317:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+18:10515:x1876607714223104:12345-192.168.201.50@tcp:41:rm.0 00000004:00000024:3.0:1789672875.430393:0:11081:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1789672875.430488:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+18:10515:x1876607714223104:12345-192.168.201.50@tcp:41:rm.0 Request processed in 174us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672875.430497:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:2.0:1789672875.438966:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672875.439135:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714223232 00000100:00100000:1.0:1789672875.439150:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714223232 00000100:00100000:1.0:1789672875.439235:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 37 00000100:00100000:1.0:1789672875.439249:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+18:10515:x1876607714223232:12345-192.168.201.50@tcp:101:rm.0 00010000:00010000:1.0:1789672875.439279:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672875.439306:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609a00/0x6c78c4f8c9965271 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24fcc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.439402:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965278 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.439422:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965278 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.439436:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965278 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.439464:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996527f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.439473:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996527f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672875.439481:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996527f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.443942:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965286 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.443976:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.443993:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672875.444075:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789672875.444099:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789672875.444129:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444145:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444156:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965278 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444163:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965278 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444172:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965278 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444178:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61609c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672875.444183:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965278 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444192:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965278 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444206:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cfc4990a300) 00010000:00010000:3.0:1789672875.444210:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672875.444215:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965278 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444223:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965278 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444246:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996527f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444263:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996527f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444270:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996527f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444275:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61608a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672875.444278:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996527f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444284:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996527f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444292:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x53e8e04c (ffff8cfb419b1100) 00010000:00010000:3.0:1789672875.444294:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672875.444297:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996527f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444303:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608a00/0x6c78c4f8c996527f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444354:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609a00/0x6c78c4f8c9965271 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fcc expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444372:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965286 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fcc expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.444379:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cfc4afc7400) 00010000:00010000:3.0:1789672875.444381:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672875.444391:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc61608e00, rc 0) 00000100:00100000:3.0:1789672875.444498:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:10515:x1876607714223232:12345-192.168.201.50@tcp:101:rm.0 Request processed in 5251us (5548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672875.444519:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 37 00000100:00100000:0.0:1789672875.452854:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672875.453179:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714223488 00000100:00100000:2.0:1789672875.453194:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714223488 00000100:00100000:2.0:1789672875.453273:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 38 00000100:00100000:2.0:1789672875.453286:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:10515:x1876607714223488:12345-192.168.201.50@tcp:36:rm.0 00010000:00010000:2.0:1789672875.453363:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789672875.453397:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608e00/0x6c78c4f8c9965286 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fcc expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.453424:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c9965232 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fb0 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.453437:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cfc4afc7400) 00010000:00010000:2.0:1789672875.453447:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965247 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fb7 expref: 17 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.453455:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cfc4990a300) 00010000:00010000:2.0:1789672875.453475:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672875.453500:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996528d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.453530:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996528d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.453541:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996528d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.453554:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965294 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.453562:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965294 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.453568:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965294 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.453710:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c996529b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.453720:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c996529b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.453727:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c996529b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789672875.457650:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789672875.457699:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 353373038473ns, next at 354373031801ns, rc = 0 00010000:00010000:2.0:1789672875.457787:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99652a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.457821:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99652a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.457844:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99652a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.457854:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99652a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.457860:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99652a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.457866:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99652a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.457894:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789672875.457917:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c996529b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.457923:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c996529b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.457929:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c996529b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.457935:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aee000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672875.457939:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c996529b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.457946:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c996529b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.457971:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cfc4afc7400) 00010000:00010000:2.0:1789672875.457974:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789672875.457980:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c996529b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.457986:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c996529b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.458006:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996528d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.458012:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996528d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.458017:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996528d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.458022:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aeee00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672875.458025:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996528d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.458030:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996528d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.458037:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cfc4990a300) 00010000:00010000:2.0:1789672875.458039:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672875.458042:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996528d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.458047:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996528d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789672875.458067:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd51c09a reply state 00000000474a1d30 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965294 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.458080:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965294 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.458086:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x53e8e04c (ffff8cfb419b1100) 00010000:00010000:2.0:1789672875.458087:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789672875.458091:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789672875.458655:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+18:10515:x1876607714223488:12345-192.168.201.50@tcp:36:rm.0 Request processed in 5366us (5814us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789672875.458690:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 38 00010000:00010000:3.0:1789672875.458993:0:13186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672875.459010:0:13186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99652a2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.459021:0:13186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aeea00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789672875.459027:0:13186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99652a2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.459038:0:13186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99652a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.459064:0:13186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cfc4afc7400) 00010000:00010000:3.0:1789672875.459069:0:13186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789672875.459075:0:13186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99652a2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.459081:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99652a2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672875.459100:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672875.459102:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672875.459104:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672875.467515:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672875.467612:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714223744 00000100:00100000:2.0:1789672875.467622:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714223744 00000100:00100000:0.0:1789672875.467768:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:0.0:1789672875.467781:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+18:10515:x1876607714223744:12345-192.168.201.50@tcp:35:rm.0 00000100:00100000:0.0:1789672875.468157:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:10515:x1876607714223744:12345-192.168.201.50@tcp:35:rm.0 Request processed in 377us (663us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789672875.468166:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:0.0:1789672875.472748:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672875.472874:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714224000 00000100:00100000:2.0:1789672875.472884:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714224000 00000100:00100000:2.0:1789672875.472947:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:2.0:1789672875.472957:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:10515:x1876607714224000:12345-192.168.201.50@tcp:36:rm.0 00010000:00010000:2.0:1789672875.473012:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789672875.473037:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965263 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fc5 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473060:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965201 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fa2 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473072:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cfc4990a300) 00010000:00010000:2.0:1789672875.473089:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61608800/0x6c78c4f8c99651c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f94 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473111:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc821d4800) 00010000:00010000:2.0:1789672875.473118:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672875.473151:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99652a9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473172:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99652a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473183:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99652a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473197:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c99652b0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473204:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c99652b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473211:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c99652b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473290:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c99652b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473298:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c99652b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473304:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c99652b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672875.473540:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789672875.473556:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c99652b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473569:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c99652b7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473575:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c99652b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473581:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aef200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672875.473585:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c99652b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473592:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c99652b7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473600:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8cfc4990a800) 00010000:00010000:2.0:1789672875.473603:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789672875.473607:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c99652b7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473613:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c99652b7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473631:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99652a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473637:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99652a9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473642:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99652a9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473648:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aeee00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672875.473681:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99652a9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473688:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99652a9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473697:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc4990a600) 00010000:00010000:2.0:1789672875.473700:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672875.473703:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99652a9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473708:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99652a9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789672875.473720:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed2eeb27 reply state 00000000a1ead278 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c99652b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473730:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c99652b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672875.473736:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cfc4990a100) 00010000:00010000:2.0:1789672875.473739:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789672875.473741:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789672875.473805:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+18:10515:x1876607714224000:12345-192.168.201.50@tcp:36:rm.0 Request processed in 849us (1066us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789672875.473812:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:0.0:1789672875.844862:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672875.844885:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738427392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789672875.844961:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672875.847022:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738427392 00000100:00100000:3.0:1789672875.847035:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738427392 00000100:00100000:3.0:1789672875.847104:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789672875.847124:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738427392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789672875.847167:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789672875.847268:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738427392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (2307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672875.847276:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789672875.847542:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738427392:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789672876.228258:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672877.251820:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672877.380877:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738427520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789672877.381005:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672877.381115:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738427520 00000100:00100000:3.0:1789672877.381126:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738427520 00000100:00100000:3.0:1789672877.381196:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789672877.381209:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738427520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789672877.381247:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672877.381301:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738427520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672877.381309:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1789672877.381334:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789672877.381373:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc41219500 x1876607738427520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672877.381397:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738427520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789672877.381616:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672877.381629:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738427648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672877.381707:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672877.381746:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738427648 00000100:00100000:1.0:1789672877.381750:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738427648 00000100:00100000:1.0:1789672877.381783:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789672877.381790:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738427648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789672877.381801:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672877.381834:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738427648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672877.381840:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:1.0:1789672877.381865:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462eb800 x1876607738427648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672877.381880:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738427648:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789672877.381947:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789672877.387975:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738427776:0@lo:400:kworker.0 00000100:00100000:2.0:1789672877.388077:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672877.388182:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738427776 00000100:00100000:3.0:1789672877.388194:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738427776 00000100:00100000:3.0:1789672877.388265:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789672877.388276:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738427776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672877.393799:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738427776:12345-0@lo:400:kworker.0 Request processed in 5511us (5708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672877.393819:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789672877.393916:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738428160:0@lo:400:kworker.0 00000100:00100000:3.0:1789672877.396900:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672877.397278:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738428160 00000100:00100000:3.0:1789672877.397292:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738428160 00000100:00100000:3.0:1789672877.397371:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789672877.397383:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738428160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672877.397466:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738428160:12345-0@lo:400:kworker.0 Request processed in 86us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672877.397483:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789672877.397543:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738428160:0@lo:400:kworker.0 00000100:00100000:2.0:1789672877.399296:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738427776:0@lo:400:kworker.0 00000100:00100000:2.0:1789672877.400951:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738428288:0@lo:400:kworker.0 00000100:00100000:2.0:1789672877.401050:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672877.401224:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738428288 00000100:00100000:3.0:1789672877.401234:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738428288 00000100:00100000:3.0:1789672877.401305:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789672877.401317:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738428288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672877.401412:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738428288:12345-0@lo:400:kworker.0 Request processed in 97us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672877.401421:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789672877.401490:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738428288:0@lo:400:kworker.0 00000100:00100000:3.0:1789672877.402334:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738428672:0@lo:400:kworker.0 00000100:00100000:3.0:1789672877.402384:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672877.402461:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738428672 00000100:00100000:2.0:1789672877.402497:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738428672 00000100:00100000:2.0:1789672877.402553:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789672877.402562:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738428672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672877.409315:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738428672:12345-0@lo:400:kworker.0 Request processed in 6737us (6913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672877.409337:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789672877.412201:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738427904:0@lo:400:kworker.0 00000100:00100000:1.0:1789672877.412300:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672877.412358:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738428416:0@lo:400:kworker.0 00000100:00100000:1.0:1789672877.412382:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672877.412399:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738428928:0@lo:400:kworker.0 00000100:00100000:1.0:1789672877.412416:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672877.412446:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789672877.412452:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738428032:0@lo:400:kworker.0 00000100:00100000:1.0:1789672877.412492:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672877.412510:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738428544:0@lo:400:kworker.0 00000100:00100000:1.0:1789672877.412529:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672877.412548:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738429056:0@lo:400:kworker.0 00000100:00100000:1.0:1789672877.412580:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672877.412615:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738427904 00000100:00100000:1.0:1789672877.412625:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738427904 00000100:00100000:1.0:1789672877.412709:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738428416 00000100:00100000:1.0:1789672877.412712:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738428416 00000100:00100000:1.0:1789672877.412731:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738428928 00000100:00100000:1.0:1789672877.412733:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738428928 00000100:00100000:1.0:1789672877.412746:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738428544 00000100:00100000:1.0:1789672877.412748:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738428544 00000100:00100000:1.0:1789672877.412760:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738429056 00000100:00100000:1.0:1789672877.412762:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738429056 00000100:00100000:1.0:1789672877.412779:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789672877.412789:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738427904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672877.412864:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738427904:12345-0@lo:400:kworker.0 Request processed in 62us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672877.412872:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789672877.412892:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789672877.412898:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738428416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672877.412924:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738428416:12345-0@lo:400:kworker.0 Request processed in 27us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672877.412940:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789672877.412952:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789672877.413073:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789672877.413086:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738428544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672877.413123:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738428544:12345-0@lo:400:kworker.0 Request processed in 42us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672877.413129:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789672877.413143:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789672877.413149:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738429056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672877.413176:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738429056:12345-0@lo:400:kworker.0 Request processed in 28us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672877.413182:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789672877.413230:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738428928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672877.413261:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738428928:12345-0@lo:400:kworker.0 Request processed in 304us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672877.413267:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789672877.413287:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738428032 00000100:00100000:1.0:1789672877.413291:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738428032 00000100:00100000:1.0:1789672877.413371:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789672877.413378:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738428032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672877.413415:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738428032:12345-0@lo:400:kworker.0 Request processed in 38us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672877.413422:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00010000:00080000:3.0:1789672877.416410:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47a2b800 x1876607738428672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672877.416436:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738428672:0@lo:400:kworker.0 00000100:00100000:3.0:1789672877.419761:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789672877.419783:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738428800:0@lo:400:kworker.0 00000100:00100000:3.0:1789672877.419909:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672877.420113:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738428800 00000100:00100000:3.0:1789672877.420125:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738428800 00000100:00100000:3.0:1789672877.420202:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789672877.420214:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738428800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672877.420283:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738428800:12345-0@lo:400:kworker.0 Request processed in 71us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672877.420291:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1789672877.420323:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789672877.420330:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789672877.420335:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789672877.420370:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47a2aa00 x1876607738428800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672877.420388:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738428800:0@lo:400:kworker.0 00000100:00100000:1.0:1789672877.436101:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738428032:0@lo:400:kworker.0 00010000:00080000:1.0:1789672877.436132:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47a2a300 x1876607738428544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672877.436144:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738428544:0@lo:400:kworker.0 00010000:00080000:1.0:1789672877.436157:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47a28380 x1876607738429056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672877.436164:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738429056:0@lo:400:kworker.0 00000100:00100000:1.0:1789672877.436180:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738427904:0@lo:400:kworker.0 00000100:00100000:1.0:1789672877.436193:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738428416:0@lo:400:kworker.0 00000100:00100000:1.0:1789672877.436207:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738428928:0@lo:400:kworker.0 00010000:00010000:2.0:1789672878.275984:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789672878.916140:0:8493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356831476705ns, next at 357831472449ns, rc = 0 00000100:00100000:1.0:1789672878.916183:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672878.916212:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738429184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672878.916305:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672878.916412:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738429184 00000100:00100000:1.0:1789672878.916422:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738429184 00000100:00100000:1.0:1789672878.916495:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789672878.916520:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738429184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672878.916576:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672878.916634:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738429184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672878.916643:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:1.0:1789672878.916726:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47ac3b80 x1876607738429184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672878.916764:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738429184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672878.926931:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789672878.926964:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738429312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789672878.927060:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672878.927560:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738429312 00000100:00100000:2.0:1789672878.927574:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738429312 00000100:00100000:2.0:1789672878.927650:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789672878.927695:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738429312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789672878.927729:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672878.927822:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738429312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672878.927838:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:0.0:1789672878.928045:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb477a3100 x1876607738429312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672878.928079:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738429312:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789672879.300016:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672879.940782:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738429440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789672879.940883:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672879.942493:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738429440 00000100:00100000:2.0:1789672879.942510:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738429440 00000100:00100000:2.0:1789672879.942752:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789672879.942766:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738429440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789672879.942817:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789672879.942917:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738429440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 154us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672879.942924:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789672879.945161:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738429440:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1789672879.971967:0:13681:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1789672880.088079:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672880.088485:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672880.088519:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672880.088545:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672880.088571:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672880.088603:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672880.088638:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714224384 00000100:00100000:0.0:1789672880.088649:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714224384 00000100:00100000:0.0:1789672880.088758:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714224640 00000100:00100000:0.0:1789672880.088762:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714224640 00000100:00100000:0.0:1789672880.088779:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714224256 00000100:00100000:0.0:1789672880.088782:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714224256 00000100:00100000:0.0:1789672880.088796:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714224768 00000100:00100000:0.0:1789672880.088798:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714224768 00000100:00100000:0.0:1789672880.088818:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 232 00000100:00100000:0.0:1789672880.088830:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714224384:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672880.088926:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714224384:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 98us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672880.088934:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 232 00000100:00100000:0.0:1789672880.088973:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 233 00000100:00100000:0.0:1789672880.088980:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714224640:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672880.089016:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714224640:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 37us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672880.089023:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 233 00000100:00100000:0.0:1789672880.089051:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 234 00000100:00100000:0.0:1789672880.089057:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+18:2397:x1876607714224256:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672880.089083:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+18:2397:x1876607714224256:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 26us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672880.089089:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 234 00000100:00100000:0.0:1789672880.089102:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 235 00000100:00100000:0.0:1789672880.089108:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714224768:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672880.089128:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714224768:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 20us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672880.089133:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 235 00000100:00100000:0.0:1789672880.089155:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714224512 00000100:00100000:0.0:1789672880.089159:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714224512 00000100:00100000:0.0:1789672880.089188:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 82 00000100:00100000:0.0:1789672880.089194:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714224512:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672880.089217:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714224512:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 23us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672880.089223:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 82 00000100:00080000:0.0:1789672880.089242:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789672880.089247:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672880.089249:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789672880.089486:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714224128 00000100:00100000:3.0:1789672880.089491:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714224128 00000100:00100000:3.0:1789672880.089524:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 342 00000100:00100000:3.0:1789672880.089530:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714224128:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672880.089562:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714224128:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 33us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672880.089568:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 342 00010000:00010000:2.0:1789672880.327500:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672880.972321:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738429568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789672880.972451:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672880.972724:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738429568 00000100:00100000:2.0:1789672880.972738:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738429568 00000100:00100000:2.0:1789672880.973441:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789672880.973458:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738429568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789672880.973516:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789672880.973619:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738429568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 166us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672880.973628:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789672880.974204:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738429568:0@lo:41:osp-pre-0-1.0 00000004:00080000:0.0:1789672880.977778:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1789672880.977827:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1789672880.977837:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1789672880.978082:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965216 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978095:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965216 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978104:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965216 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978110:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672880.978115:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965216 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978122:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965216 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978139:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x53e8e04c (ffff8cfb419b1100) 00010000:00010000:0.0:1789672880.978142:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672880.978148:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965216 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978154:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965216 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978174:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c996522b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978179:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c996522b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978187:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c996522b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978199:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cca00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672880.978203:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c996522b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978209:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c996522b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978216:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8cfc4afc7400) 00010000:00010000:0.0:1789672880.978218:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672880.978221:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c996522b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978227:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c996522b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978244:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965294 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978251:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965294 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978258:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965294 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978263:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aef800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672880.978266:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965294 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978272:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965294 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978289:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x53e8e04c (ffff8cfb419b1100) 00010000:00010000:0.0:1789672880.978292:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672880.978295:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965294 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978302:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965294 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x53e8e04c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978318:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c99652b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978324:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c99652b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978331:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c99652b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978337:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aee000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672880.978340:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c99652b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978346:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c99652b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978353:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cfc4990a100) 00010000:00010000:0.0:1789672880.978356:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672880.978358:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c99652b0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672880.978364:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee000/0x6c78c4f8c99652b0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672880.978702:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672880.978730:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738429696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789672880.978834:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672880.979163:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738429696 00000100:00100000:3.0:1789672880.979173:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738429696 00000100:00080000:0.0:1789672880.979232:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672880.979255:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789672880.979268:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738429696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789672880.979301:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1789672880.979343:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aac3da9, atime: 0x6aac3da9, ctime: 0x6aac3da9, blocks: 0x0 00010000:00010000:3.0:1789672880.980209:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a09c4750/0x6c78c4f8c99652be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672880.980234:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1789672880.980239:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672880.980249:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a09c4750/0x6c78c4f8c99652be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672880.980275:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a09c4750/0x6c78c4f8c99652be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672880.980288:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a09c4750/0x6c78c4f8c99652be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672880.980297:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a09c4750/0x6c78c4f8c99652be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672880.980324:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789672880.980788:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1876607738429696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1520us (1952us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789672880.980799:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789672880.980955:0:13186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672880.980965:0:13186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a09c4750/0x6c78c4f8c99652be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672880.980975:0:13186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886c00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789672880.980981:0:13186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a09c4750/0x6c78c4f8c99652be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672880.981003:0:13186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a09c4750/0x6c78c4f8c99652be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672880.981026:0:13186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a09c4750/0x6c78c4f8c99652be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672880.981033:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a09c4750/0x6c78c4f8c99652be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789672880.981075:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfc4121aa00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789672880.981088:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738429696:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789672880.981165:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672880.981167:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672880.981169:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789672881.037080:0:13729:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe11866570 20000000:00000080:0.0:1789672881.037103:0:13729:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cfc7f5b2000 uarg=0000000000000000 20000000:01000000:0.0:1789672881.037163:0:13729:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789672881.037171:0:13729:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789672881.037177:0:13729:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789672881.037835:0:13730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789672881.037971:0:13729:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789672881.044213:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789672881.044248:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789672881.044266:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789672881.044300:0:13729:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789672881.044320:0:13729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfc7d8cca00/0x6c78c4f8c99652c5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672881.044341:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996514b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f7f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672881.044350:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9965152 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f86 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672881.044359:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c9965160 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9965159 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672881.044366:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d8a1a00/0x6c78c4f8c996516e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9965167 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672881.044372:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d8a0a00/0x6c78c4f8c996517c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9965175 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672881.044392:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d8cda00/0x6c78c4f8c996518a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9965183 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672881.044400:0:13729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfc7d8cca00/0x6c78c4f8c99652c5 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672881.044452:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d8cda00/0x6c78c4f8c996518a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9965183 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672881.044466:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc7d8cda00/0x6c78c4f8c996518a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9965183 expref: 23 pid: 6504 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672881.044481:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f601880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1876607738429824:0@lo:104: 00000100:00100000:0.0:1789672881.044796:0:13729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789672881.045182:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d8a0a00/0x6c78c4f8c996517c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9965175 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672881.045192:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc7d8a0a00/0x6c78c4f8c996517c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9965175 expref: 23 pid: 6504 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672881.045202:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f600700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1876607738429952:0@lo:104: 00010000:00010000:0.0:1789672881.045227:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d8a1a00/0x6c78c4f8c996516e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9965167 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672881.045236:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc7d8a1a00/0x6c78c4f8c996516e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9965167 expref: 23 pid: 6504 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672881.045243:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f601f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1876607738430080:0@lo:104: 00010000:00010000:0.0:1789672881.045266:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c9965160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9965159 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672881.045282:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c9965160 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9965159 expref: 23 pid: 6506 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672881.045291:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f601c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1876607738430208:0@lo:104: 00000100:00100000:3.0:1789672881.045295:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1789672881.045325:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9965152 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f86 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672881.045338:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9965152 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f86 expref: 12 pid: 6504 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672881.045355:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f600e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1876607738430336:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672881.045360:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672881.045707:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738429824 00000100:00100000:2.0:1789672881.045720:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738429824 00000100:00100000:2.0:1789672881.045782:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738429952 00000100:00100000:2.0:1789672881.045785:0:6495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738429952 00000100:00100000:2.0:1789672881.045804:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789672881.045815:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f586450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:13729:x1876607738429824:12345-0@lo:104: 00010000:00010000:2.0:1789672881.045835:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0000/0x6c78c4f8c9965183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c996518a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672881.054476:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672881.054501:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672881.054517:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738430080 00000100:00100000:3.0:1789672881.054527:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738430080 00000100:00100000:3.0:1789672881.054590:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738430208 00000100:00100000:3.0:1789672881.054594:0:6494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738430208 00000100:00100000:3.0:1789672881.054612:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789672881.054624:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+6:13729:x1876607738429952:12345-0@lo:104: 00010000:00010000:3.0:1789672881.054647:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9965175 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c996517c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.055238:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789672881.055248:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+6:13729:x1876607738429952:12345-0@lo:104: Request processed in 626us (9908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672881.055256:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789672881.055290:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789672881.055301:0:6494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:13729:x1876607738430080:12345-0@lo:104: 00010000:00010000:3.0:1789672881.055312:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9965167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c996516e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672881.056796:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996514b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f7f expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672881.056818:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996514b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f7f expref: 12 pid: 6506 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672881.056836:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f602a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1876607738430464:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789672881.059466:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789672881.060326:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f586450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+5:13729:x1876607738429824:12345-0@lo:104: Request processed in 13670us (14688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672881.060346:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789672881.060452:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789672881.060468:0:6495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:13729:x1876607738430208:12345-0@lo:104: 00010000:00010000:2.0:1789672881.060586:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1000/0x6c78c4f8c9965159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9965160 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.060703:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789672881.060710:0:6495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+4:13729:x1876607738430208:12345-0@lo:104: Request processed in 250us (6208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672881.060717:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1789672881.060772:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789672881.060780:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9965175 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c996517c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.060789:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a1e00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:2.0:1789672881.060794:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9965175 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c996517c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.060806:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9965175 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c996517c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672881.060814:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9965175 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c996517c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672881.060821:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789672881.060870:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9965175 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996517c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.060877:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672881.060909:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9965175 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996517c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.060916:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1e00/0x6c78c4f8c9965175 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996517c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.060940:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789672881.060944:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0000/0x6c78c4f8c9965183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c996518a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.060951:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0000 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:2.0:1789672881.060954:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0000/0x6c78c4f8c9965183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c996518a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.060961:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0000/0x6c78c4f8c9965183 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c996518a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672881.060967:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0000/0x6c78c4f8c9965183 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c996518a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672881.060972:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789672881.060987:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0000/0x6c78c4f8c9965183 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996518a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.060993:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672881.061012:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0000/0x6c78c4f8c9965183 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996518a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.061018:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0000/0x6c78c4f8c9965183 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996518a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.061048:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672881.061051:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1000/0x6c78c4f8c9965159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9965160 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.061067:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a1000 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:2.0:1789672881.061071:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1000/0x6c78c4f8c9965159 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9965160 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.061078:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1000/0x6c78c4f8c9965159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9965160 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672881.061084:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1000/0x6c78c4f8c9965159 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9965160 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672881.061089:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789672881.061104:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1000/0x6c78c4f8c9965159 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9965160 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.061109:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789672881.061400:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789672881.061420:0:6494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+3:13729:x1876607738430080:12345-0@lo:104: Request processed in 6121us (6955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672881.061438:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1789672881.061463:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672881.061468:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9965167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c996516e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.061476:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0400 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:3.0:1789672881.061480:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9965167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c996516e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.061501:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9965167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c996516e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672881.061509:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9965167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c996516e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672881.061514:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789672881.061530:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9965167 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996516e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.061536:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789672881.061543:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9965167 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996516e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.061550:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0400/0x6c78c4f8c9965167 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996516e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.061560:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672881.061562:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672881.061563:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672881.061696:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1000/0x6c78c4f8c9965159 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9965160 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.061703:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a1000/0x6c78c4f8c9965159 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9965160 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.061721:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672881.061723:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672881.061725:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672881.061732:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672881.061923:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738430592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672881.061975:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672881.062030:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672881.062129:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738430592 00000100:00100000:3.0:1789672881.062145:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738430592 00010000:00010000:3.0:1789672881.062181:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d8a0a00/0x6c78c4f8c996517c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9965175 expref: 24 pid: 6504 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672881.062220:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789672881.062229:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738430592:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789672881.062234:0:13729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d839540 going to sleep for 11 seconds 00010000:00010000:3.0:1789672881.062245:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672881.062254:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d8a0a00/0x6c78c4f8c996517c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9965175 expref: 24 pid: 6504 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.062266:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d8a0a00/0x6c78c4f8c996517c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9965175 expref: 24 pid: 6504 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672881.062279:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f601880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1876607738429824:0@lo:104: 00010000:00010000:3.0:1789672881.062290:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672881.062297:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8a0a00/0x6c78c4f8c996517c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9965175 expref: 24 pid: 6504 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672881.062330:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f600700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1876607738429952:0@lo:104: 00000100:00100000:3.0:1789672881.062339:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:3638:x1876607738430592:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672881.062353:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789672881.062715:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f601f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1876607738430080:0@lo:104: 00000100:00100000:0.0:1789672881.062731:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f601c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1876607738430208:0@lo:104: 00000100:00100000:2.0:1789672881.065249:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738430848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672881.065374:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672881.065472:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738430592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789672881.065494:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738430848 00000100:00100000:2.0:1789672881.065529:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb477a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738430720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789672881.065718:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738430848 00010000:00010000:0.0:1789672881.065763:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c9965160 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9965159 expref: 23 pid: 6506 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672881.065848:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672881.065888:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672881.065895:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738430976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672881.065917:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672881.065957:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738430720 00000100:00100000:2.0:1789672881.065964:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738430720 00010000:00010000:2.0:1789672881.065996:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d8cda00/0x6c78c4f8c996518a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9965183 expref: 24 pid: 6504 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672881.066028:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738430976 00000100:00100000:2.0:1789672881.066031:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738430976 00010000:00010000:2.0:1789672881.066044:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d8a1a00/0x6c78c4f8c996516e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9965167 expref: 25 pid: 6504 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672881.066060:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789672881.066070:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+25:3635:x1876607738430720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789672881.066086:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672881.066092:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d8cda00/0x6c78c4f8c996518a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9965183 expref: 25 pid: 6504 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.066105:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d8cda00/0x6c78c4f8c996518a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9965183 expref: 25 pid: 6504 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.066126:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8cda00/0x6c78c4f8c996518a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9965183 expref: 25 pid: 6504 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.066157:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672881.066200:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3635:x1876607738430720:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672881.066208:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789672881.066229:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789672881.066236:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:3635:x1876607738430976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789672881.066244:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672881.066248:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d8a1a00/0x6c78c4f8c996516e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9965167 expref: 23 pid: 6504 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.066257:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d8a1a00/0x6c78c4f8c996516e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9965167 expref: 23 pid: 6504 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.066267:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8a1a00/0x6c78c4f8c996516e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9965167 expref: 23 pid: 6504 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.066276:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672881.066296:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:3635:x1876607738430976:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672881.066302:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789672881.066314:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789672881.066320:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3638:x1876607738430848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789672881.066329:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672881.066333:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c9965160 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9965159 expref: 21 pid: 6506 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.066344:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c9965160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9965159 expref: 21 pid: 6506 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.066362:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c9965160 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9965159 expref: 21 pid: 6506 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672881.066371:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672881.066398:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:3638:x1876607738430848:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672881.066417:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789672881.066447:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738430976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672881.066456:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738430720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672881.066482:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb477a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738430848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789672881.067289:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f600e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1876607738430336:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672881.067468:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672881.067649:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672881.067713:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f602a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1876607738430464:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789672881.067773:0:13729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfc7d8cca00/0x6c78c4f8c99652c5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672881.067976:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714224896 00000100:00100000:3.0:1789672881.067986:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714224896 00010000:00010000:3.0:1789672881.068024:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9965152 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f86 expref: 13 pid: 6504 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672881.068057:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714225024 00000100:00100000:3.0:1789672881.068061:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714225024 00010000:00010000:3.0:1789672881.068073:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996514b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f7f expref: 14 pid: 6506 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672881.068102:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:3.0:1789672881.068112:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e362d29-d6a4-4e54-8405-94913e6a9c61+14:2396:x1876607714224896:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672881.068129:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672881.068149:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9965152 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f86 expref: 14 pid: 6504 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.068162:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9965152 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f86 expref: 14 pid: 6504 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.068180:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c9965152 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f86 expref: 14 pid: 6504 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.068196:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672881.068263:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2396:x1876607714224896:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 152us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672881.068272:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:3.0:1789672881.068291:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:3.0:1789672881.068298:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:2395:x1876607714225024:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672881.068306:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672881.068310:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996514b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f7f expref: 12 pid: 6506 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.068320:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996514b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f7f expref: 12 pid: 6506 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.068329:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996514b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f7f expref: 12 pid: 6506 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.068342:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfc7d8cca00/0x6c78c4f8c99652c5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.068352:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8cca00/0x6c78c4f8c99652c5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.068378:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc7d8cca00/0x6c78c4f8c99652c5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.068387:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc7d8cca00/0x6c78c4f8c99652c5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.068394:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfc7d8cca00/0x6c78c4f8c99652c5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.068417:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfc7d8cca00/0x6c78c4f8c99652c5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.068425:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cca00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789672881.068430:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfc7d8cca00/0x6c78c4f8c99652c5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.068440:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfc7d8cca00/0x6c78c4f8c99652c5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.068469:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfc7d8cca00/0x6c78c4f8c99652c5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672881.068481:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672881.068509:0:13729:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfc7d8cca00/0x6c78c4f8c99652c5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672881.068519:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:2395:x1876607714225024:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 217us (866us total) trans 0 rc 0/0 00010000:00010000:0.0:1789672881.068536:0:13729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8cca00/0x6c78c4f8c99652c5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672881.068550:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8cca00/0x6c78c4f8c99652c5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672881.069331:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 51 00010000:00010000:3.0:1789672881.352078:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789672882.003300:0:13778:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec2f08ce0 20000000:00000080:1.0:1789672882.003319:0:13778:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cfc7da60c00 uarg=0000000000000000 20000000:01000000:1.0:1789672882.003361:0:13778:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1789672882.003367:0:13778:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1789672882.003372:0:13778:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1789672882.005753:0:13780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789672882.008339:0:13778:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1789672882.008477:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1789672882.008514:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1789672882.008554:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1789672882.008567:0:13778:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789672882.008589:0:13778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99652cc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672882.008605:0:13778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99652cc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672882.008616:0:13778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99652cc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672882.008623:0:13778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99652cc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672882.008630:0:13778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99652cc lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672882.008637:0:13778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99652cc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672882.008644:0:13778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887c00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789672882.008648:0:13778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99652cc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672882.008681:0:13778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99652cc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672882.008695:0:13778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99652cc lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672882.008703:0:13778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99652cc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672882.008719:0:13778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99652cc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672882.376338:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672882.500241:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738431488:0@lo:400:kworker.0 00000100:00100000:0.0:1789672882.500307:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672882.500373:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876607738432000:0@lo:400:kworker.0 00000100:00100000:0.0:1789672882.500423:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672882.500447:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738432512:0@lo:400:kworker.0 00000100:00100000:0.0:1789672882.500464:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672882.500486:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789672882.500491:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738431104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789672882.500511:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672882.500537:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738431616:0@lo:400:kworker.0 00000100:00100000:0.0:1789672882.500554:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672882.500567:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738432128:0@lo:400:kworker.0 00000100:00100000:0.0:1789672882.500585:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672882.500597:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738432640:0@lo:400:kworker.0 00000100:00100000:0.0:1789672882.500612:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672882.500637:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738432000 00000100:00100000:0.0:1789672882.500644:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738432000 00000100:00100000:0.0:1789672882.500713:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738432512 00000100:00100000:0.0:1789672882.500716:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738432512 00000100:00100000:0.0:1789672882.500732:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738431616 00000100:00100000:0.0:1789672882.500735:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738431616 00000100:00100000:0.0:1789672882.500747:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789672882.500755:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876607738432000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672882.500800:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876607738432000:12345-0@lo:400:kworker.0 Request processed in 46us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672882.500807:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789672882.500836:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789672882.500840:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738432512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672882.500862:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738432512:12345-0@lo:400:kworker.0 Request processed in 21us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672882.500867:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789672882.500888:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789672882.500894:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738431616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672882.500916:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738431616:12345-0@lo:400:kworker.0 Request processed in 22us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672882.500930:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789672882.501055:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738432128 00000100:00100000:3.0:1789672882.501059:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738432128 00000100:00100000:3.0:1789672882.501083:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738432640 00000100:00100000:3.0:1789672882.501085:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738432640 00000100:00100000:3.0:1789672882.501102:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789672882.501108:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738432128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672882.501139:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738432128:12345-0@lo:400:kworker.0 Request processed in 32us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672882.501145:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789672882.501154:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789672882.501160:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738432640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672882.501180:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738432640:12345-0@lo:400:kworker.0 Request processed in 21us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672882.501185:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1789672882.501218:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789672882.501221:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789672882.501224:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789672882.501251:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738431616:0@lo:400:kworker.0 00000100:00100000:3.0:1789672882.501262:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738432128:0@lo:400:kworker.0 00010000:00080000:3.0:1789672882.501272:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb479d3100 x1876607738432640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672882.501282:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738432640:0@lo:400:kworker.0 00010000:00080000:3.0:1789672882.501299:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb479d0380 x1876607738432000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672882.501307:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876607738432000:0@lo:400:kworker.0 00010000:00080000:3.0:1789672882.501315:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb479d1f80 x1876607738432512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672882.501323:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738432512:0@lo:400:kworker.0 00000100:00100000:1.0:1789672882.501372:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738431488 00000100:00100000:1.0:1789672882.501386:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738431488 00000100:00100000:1.0:1789672882.501412:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789672882.501418:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738431488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672882.501451:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738431488:12345-0@lo:400:kworker.0 Request processed in 34us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672882.501457:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789672882.501480:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738431104 00000100:00100000:1.0:1789672882.501483:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738431104 00000100:00100000:1.0:1789672882.501502:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789672882.501507:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738431104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789672882.501526:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672882.501553:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738431104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672882.501559:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789672882.501688:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738431232:0@lo:400:kworker.0 00000100:00100000:2.0:1789672882.501721:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672882.501756:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738431744:0@lo:400:kworker.0 00000100:00100000:2.0:1789672882.501776:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672882.501798:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738432256:0@lo:400:kworker.0 00000100:00100000:2.0:1789672882.501815:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672882.501830:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738432768:0@lo:400:kworker.0 00000100:00100000:2.0:1789672882.501845:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672882.501860:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789672882.501866:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738431360:0@lo:400:kworker.0 00000100:00100000:2.0:1789672882.501887:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672882.501903:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738431872:0@lo:400:kworker.0 00000100:00100000:2.0:1789672882.501930:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672882.501956:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738432384:0@lo:400:kworker.0 00000100:00100000:2.0:1789672882.501986:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672882.502002:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738432896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672882.502019:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672882.502044:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738431360 00000100:00100000:2.0:1789672882.502047:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738431360 00000100:00100000:2.0:1789672882.502066:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738431872 00000100:00100000:2.0:1789672882.502069:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738431872 00000100:00100000:2.0:1789672882.502084:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738432384 00000100:00100000:2.0:1789672882.502087:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738432384 00000100:00100000:2.0:1789672882.502098:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789672882.502103:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738431360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672882.502134:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738431360:12345-0@lo:400:kworker.0 Request processed in 30us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672882.502139:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789672882.502150:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789672882.502155:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738431872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672882.502175:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738431872:12345-0@lo:400:kworker.0 Request processed in 20us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672882.502181:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789672882.502189:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789672882.502194:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738432384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672882.502212:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738432384:12345-0@lo:400:kworker.0 Request processed in 19us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672882.502218:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789672882.502239:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738431744 00000100:00100000:2.0:1789672882.502242:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738431744 00000100:00100000:2.0:1789672882.502258:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789672882.502264:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738431744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672882.502290:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738431744:12345-0@lo:400:kworker.0 Request processed in 26us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672882.502296:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789672882.502310:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738432896 00000100:00100000:2.0:1789672882.502312:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738432896 00000100:00100000:2.0:1789672882.502329:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789672882.502335:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738432896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789672882.502343:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672882.502366:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738432896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672882.502372:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789672882.502401:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738432256 00000100:00100000:2.0:1789672882.502405:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738432256 00000100:00100000:2.0:1789672882.502423:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738432768 00000100:00100000:2.0:1789672882.502426:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738432768 00000100:00100000:2.0:1789672882.502437:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789672882.502442:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3635:x1876607738432256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672882.502467:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3635:x1876607738432256:12345-0@lo:400:kworker.0 Request processed in 24us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672882.502472:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789672882.502481:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789672882.502486:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738432768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672882.502505:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738432768:12345-0@lo:400:kworker.0 Request processed in 19us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672882.502517:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1789672882.502530:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789672882.502532:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789672882.502534:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672882.502558:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738431360:0@lo:400:kworker.0 00000100:00100000:2.0:1789672882.502566:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738431872:0@lo:400:kworker.0 00000100:00100000:2.0:1789672882.502573:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738432384:0@lo:400:kworker.0 00010000:00080000:2.0:1789672882.502582:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47a2bb80 x1876607738432896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672882.502596:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738432896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672882.502605:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738431744:0@lo:400:kworker.0 00000100:00100000:2.0:1789672882.502613:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738432256:0@lo:400:kworker.0 00010000:00080000:2.0:1789672882.502620:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb479d2d80 x1876607738432768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672882.502628:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738432768:0@lo:400:kworker.0 00000100:00100000:0.0:1789672882.504291:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738431232 00000100:00100000:0.0:1789672882.504303:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738431232 00000100:00100000:0.0:1789672882.504368:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789672882.504385:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:3635:x1876607738431232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672882.504465:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:3635:x1876607738431232:12345-0@lo:400:kworker.0 Request processed in 90us (2743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672882.504473:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789672882.505116:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738431232:0@lo:400:kworker.0 00010000:00080000:3.0:1789672882.505730:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47a2a300 x1876607738431104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672882.505752:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738431104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789672882.505764:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738431488:0@lo:400:kworker.0 10000000:01000000:1.0:1789672882.883782:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789672882.883790:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfb4676b800 from 7 10000000:01000000:1.0:1789672882.883796:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789672882.883850:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.883863:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.883875:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672882.883900:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738433024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.883978:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672882.884037:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb47be2480 going to sleep for 11 seconds 00000100:00100000:3.0:1789672882.884338:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738433024 00000100:00100000:3.0:1789672882.884347:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738433024 00000100:00100000:3.0:1789672882.884420:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789672882.884430:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:6509:x1876607738433024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672882.884444:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672882.884459:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99652da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99652d3 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672882.884485:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99652da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99652d3 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672882.884495:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99652da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99652d3 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672882.884505:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887c00, rc 0) 00000100:00100000:3.0:1789672882.884565:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738433024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672882.884572:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789672882.887782:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738433024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672882.887812:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99652da expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672882.887827:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99652da expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672882.887933:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738433152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672882.887995:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672882.888039:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3900 going to sleep for 11 seconds 00000100:00100000:0.0:1789672882.888082:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738433152 00000100:00100000:0.0:1789672882.888091:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738433152 00000100:00100000:0.0:1789672882.888138:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789672882.888147:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738433152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672882.888290:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738433152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672882.888297:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789672882.888451:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738433152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672882.888489:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738433280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672882.888526:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672882.888547:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3900 going to sleep for 11 seconds 00000100:00100000:1.0:1789672882.888603:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738433280 00000100:00100000:1.0:1789672882.888607:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738433280 00000100:00100000:1.0:1789672882.888635:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789672882.888642:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738433280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.888740:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738433280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672882.888764:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789672882.888971:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738433280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672882.889387:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:13792:1876607738433408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789672882.889425:0:13792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672882.889453:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3000 going to sleep for 11 seconds 00000100:00100000:3.0:1789672882.889507:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738433408 00000100:00100000:3.0:1789672882.889512:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738433408 00000100:00100000:3.0:1789672882.889533:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789672882.889539:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:13792:x1876607738433408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789672882.889621:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:13792:x1876607738433408:12345-0@lo:502:llog_process_th.0 Request processed in 81us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672882.889628:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789672882.889715:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:13792:1876607738433408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789672882.889740:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672882.889759:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672882.889762:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789672882.889768:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfb4676b800 00000020:00000080:2.0:1789672882.889770:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789672882.889990:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672882.889995:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672882.889996:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789672882.889999:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789672882.890002:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672882.890003:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789672882.890006:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfb4676b800 00000020:00000080:2.0:1789672882.890008:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789672882.890046:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:13792:1876607738433536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789672882.890076:0:13792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672882.890095:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc593a4540 going to sleep for 11 seconds 00000100:00100000:1.0:1789672882.890148:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738433536 00000100:00100000:1.0:1789672882.890153:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738433536 00000100:00100000:1.0:1789672882.890244:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789672882.890251:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:13792:x1876607738433536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672882.890325:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:13792:x1876607738433536:12345-0@lo:502:llog_process_th.0 Request processed in 74us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672882.890332:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1789672882.892226:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f604000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:13792:1876607738433536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789672882.892263:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789672882.892271:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789672882.892273:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789672882.892277:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789672882.892508:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789672882.892529:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789672882.892540:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99652da expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672882.892551:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99652da expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672882.892562:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789672882.892565:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc816a3000 from 7 10000000:01000000:0.0:1789672882.892567:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789672882.892598:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672882.892613:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672882.892623:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672882.892643:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f603100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738433664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789672882.892734:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672882.892774:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467fb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672882.893347:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738433664 00000100:00100000:2.0:1789672882.893354:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738433664 00000100:00100000:2.0:1789672882.893402:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789672882.893410:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:6509:x1876607738433664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672882.893423:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672882.893436:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c99652e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99652e1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672882.893460:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c99652e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99652e1 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672882.893471:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c99652e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99652e1 expref: 22 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672882.893481:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aefa00, rc 0) 00000100:00100000:2.0:1789672882.893531:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738433664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672882.893538:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789672882.893648:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f603100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738433664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672882.893951:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99652e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.893962:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99652e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672882.894035:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738433792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.894066:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672882.894096:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb47be2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789672882.898717:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738433792 00000100:00100000:0.0:1789672882.898732:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738433792 00000100:00100000:0.0:1789672882.898781:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789672882.898789:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738433792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672882.898963:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738433792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (4895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672882.898971:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1789672882.900045:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672882.900073:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714225152 00000100:00100000:1.0:1789672882.900079:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714225152 00000100:00100000:1.0:1789672882.900111:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 351 00000100:00100000:1.0:1789672882.900119:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:6171:x1876607714225152:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672882.900131:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672882.900148:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc61609600/0x6c78c4f8c99652ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24fd3 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.900196:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc61609600/0x6c78c4f8c99652ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fd3 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.900208:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc61609600/0x6c78c4f8c99652ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fd3 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.900217:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc61609600, rc 0) 00000100:00100000:1.0:1789672882.900257:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:6171:x1876607714225152:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 139us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672882.900264:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 351 00000100:00100000:1.0:1789672882.900526:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738433792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.900575:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738433920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.900681:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672882.900709:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb47be2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789672882.900720:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738433920 00000100:00100000:1.0:1789672882.900724:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738433920 00000100:00100000:1.0:1789672882.900741:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789672882.901013:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738433920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.901102:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738433920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672882.901109:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789672882.901145:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738433920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.901481:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:13795:1876607738434048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672882.901513:0:13795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672882.901536:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738434048 00000100:00100000:1.0:1789672882.901541:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738434048 00000100:00100000:1.0:1789672882.901557:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789672882.901562:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:13795:x1876607738434048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672882.901620:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:13795:x1876607738434048:12345-0@lo:502:llog_process_th.0 Request processed in 57us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672882.901626:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789672882.901649:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb47be29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672882.903638:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:13795:1876607738434048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672882.904059:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672882.904069:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672882.904072:0:13795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789672882.904078:0:13795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfc816a3000 00000020:00000080:1.0:1789672882.904081:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789672882.904139:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672882.904142:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672882.904144:0:13795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789672882.904146:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672882.904149:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672882.904150:0:13795:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789672882.904154:0:13795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfc816a3000 00000020:00000080:1.0:1789672882.904155:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789672882.904209:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:13795:1876607738434176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672882.904283:0:13795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672882.904312:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738434176 00000100:00100000:1.0:1789672882.904319:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738434176 00000100:00100000:1.0:1789672882.904356:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789672882.904363:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:13795:x1876607738434176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672882.904471:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:13795:x1876607738434176:12345-0@lo:502:llog_process_th.0 Request processed in 108us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672882.904484:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789672882.905703:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb47be29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672882.905732:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:13795:1876607738434176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672882.906597:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672882.906608:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672882.906610:0:13795:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789672882.906614:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789672882.906708:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789672882.906738:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789672882.907582:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99652e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.907598:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99652e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672882.907610:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789672882.907612:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc7c498000 from 7 10000000:01000000:1.0:1789672882.907615:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789672882.907649:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.907672:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.907684:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672882.907707:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738434304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.909035:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672882.909088:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb47be29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672882.909852:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738434304 00000100:00100000:2.0:1789672882.909863:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738434304 00000100:00100000:2.0:1789672882.909913:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789672882.909929:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:6509:x1876607738434304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672882.909955:0:6507:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672882.909972:0:6507:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c99652fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99652f6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672882.910000:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c99652fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99652f6 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672882.910012:0:6507:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c99652fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99652f6 expref: 23 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672882.910021:0:6507:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee000, rc 0) 00000100:00100000:2.0:1789672882.910068:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738434304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672882.910075:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789672882.911112:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738434304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789672882.911134:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99652fd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672882.911145:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99652fd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672882.912094:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738434432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672882.912147:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672882.912603:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc67ebce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789672882.912627:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738434432 00000100:00100000:2.0:1789672882.912633:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738434432 00000100:00100000:2.0:1789672882.912679:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789672882.912693:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738434432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672882.913113:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738434432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 419us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672882.913122:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789672882.913846:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738434432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789672882.913892:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738434560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789672882.914827:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672882.914868:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc67ebce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789672882.914964:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738434560 00000100:00100000:1.0:1789672882.914971:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738434560 00000100:00100000:1.0:1789672882.915013:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789672882.915022:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738434560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.915140:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738434560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672882.915147:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789672882.915205:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f604000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738434560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.915570:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:13796:1876607738434688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672882.915605:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672882.916071:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738434688 00000100:00100000:1.0:1789672882.916078:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738434688 00000100:00100000:1.0:1789672882.916111:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789672882.916119:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:13796:x1876607738434688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672882.916320:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:13796:x1876607738434688:12345-0@lo:502:llog_process_th.0 Request processed in 201us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672882.916327:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789672882.916356:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb47be23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672882.916381:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:13796:1876607738434688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672882.916404:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672882.916412:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672882.916414:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789672882.916420:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfc7c498000 00000020:00000080:1.0:1789672882.916422:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789672882.916469:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672882.916477:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672882.916478:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789672882.916481:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672882.916483:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672882.916485:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789672882.916488:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfc7c498000 00000020:00000080:1.0:1789672882.916490:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789672882.917096:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672882.917423:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714225280 00000100:00100000:0.0:1789672882.917430:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714225280 00000100:00100000:0.0:1789672882.917464:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 359 00000100:00100000:0.0:1789672882.917472:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:6171:x1876607714225280:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672882.917914:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:6171:x1876607714225280:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 441us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672882.917923:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 359 00000100:00100000:1.0:1789672882.919250:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:13796:1876607738434816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672882.919318:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672882.919357:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738434816 00000100:00100000:1.0:1789672882.919362:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738434816 00000100:00100000:1.0:1789672882.919408:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789672882.919415:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:13796:x1876607738434816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672882.919509:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:13796:x1876607738434816:12345-0@lo:502:llog_process_th.0 Request processed in 94us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672882.919516:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789672882.919561:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb47be23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672882.919578:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:13796:1876607738434816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672882.919604:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672882.919610:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672882.919612:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789672882.919616:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789672882.919694:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789672882.919718:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789672882.919727:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99652fd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.919738:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99652fd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672882.919759:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789672882.919761:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc44f3d800 from 7 10000000:01000000:1.0:1789672882.919764:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789672882.919784:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.919792:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.919801:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672882.919813:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738434944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.919837:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672882.919849:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb47be23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672882.919860:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738434944 00000100:00100000:1.0:1789672882.919863:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738434944 00000100:00100000:1.0:1789672882.919879:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789672882.919885:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:6509:x1876607738434944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672882.919893:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672882.919904:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c996530b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9965304 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.919923:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c996530b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9965304 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.919933:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c996530b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9965304 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.919970:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc61608a00, rc 0) 00000100:00100000:1.0:1789672882.919995:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738434944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672882.920001:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789672882.920025:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738434944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789672882.920036:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996530b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.920045:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996530b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672882.920084:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738435072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.920105:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672882.920115:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb47be23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672882.920124:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738435072 00000100:00100000:1.0:1789672882.920127:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738435072 00000100:00100000:1.0:1789672882.920141:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789672882.920145:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738435072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.920217:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738435072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672882.920224:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789672882.920247:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738435072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.920267:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738435200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.920295:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672882.920311:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb46884240 going to sleep for 11 seconds 00000100:00100000:1.0:1789672882.920321:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738435200 00000100:00100000:1.0:1789672882.920323:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738435200 00000100:00100000:1.0:1789672882.920337:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789672882.920341:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738435200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.920425:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:6509:x1876607738435200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672882.920432:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789672882.920460:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:6509:1876607738435200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789672882.920704:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:13797:1876607738435328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672882.920734:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672882.920751:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738435328 00000100:00100000:1.0:1789672882.920754:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738435328 00000100:00100000:1.0:1789672882.920768:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789672882.920773:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:13797:x1876607738435328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672882.920825:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:13797:x1876607738435328:12345-0@lo:502:llog_process_th.0 Request processed in 51us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672882.920831:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789672882.920853:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb46884600 going to sleep for 11 seconds 00000100:00100000:1.0:1789672882.920863:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:13797:1876607738435328:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672882.920881:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672882.920887:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672882.920889:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789672882.920895:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfc44f3d800 00000020:00000080:1.0:1789672882.920898:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789672882.920938:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672882.920945:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672882.920946:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789672882.920949:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789672882.920951:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672882.920953:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789672882.920956:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfc44f3d800 00000020:00000080:1.0:1789672882.920958:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789672882.920985:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:13797:1876607738435456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672882.921012:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672882.921027:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738435456 00000100:00100000:1.0:1789672882.921031:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738435456 00000100:00100000:1.0:1789672882.921045:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789672882.921049:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:13797:x1876607738435456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789672882.921096:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:13797:x1876607738435456:12345-0@lo:502:llog_process_th.0 Request processed in 45us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672882.921103:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789672882.921124:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb46884600 going to sleep for 11 seconds 00000100:00100000:1.0:1789672882.921134:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:13797:1876607738435456:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789672882.921148:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789672882.921151:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789672882.921153:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789672882.921156:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789672882.921187:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789672882.921204:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789672882.921212:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996530b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672882.921222:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996530b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672882.931771:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672882.931838:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714225408 00000100:00100000:3.0:1789672882.931847:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714225408 00000100:00100000:3.0:1789672882.931898:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 366 00000100:00100000:3.0:1789672882.931908:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:6171:x1876607714225408:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789672882.933992:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789672882.951337:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:6171:x1876607714225408:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 Request processed in 19416us (19562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672882.951353:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 366 00000100:00100000:3.0:1789672882.965777:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672882.965994:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714225536 00000100:00100000:2.0:1789672882.966004:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714225536 00000100:00100000:2.0:1789672882.966050:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 367 00000100:00100000:2.0:1789672882.966059:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:10800:x1876607714225536:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789672882.966702:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:10800:x1876607714225536:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 642us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672882.966712:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 367 00000100:00100000:0.0:1789672882.977797:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672882.977926:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714225664 00000100:00100000:3.0:1789672882.977945:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714225664 00000100:00100000:3.0:1789672882.977998:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 368 00000100:00100000:3.0:1789672882.978007:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:10800:x1876607714225664:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789672882.978146:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:10800:x1876607714225664:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 139us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672882.978154:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 368 00000040:00080000:2.0:1789672882.982189:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789672882.986471:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672882.986717:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714225792 00000100:00100000:3.0:1789672882.986757:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714225792 00000100:00100000:3.0:1789672882.986831:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 369 00000100:00100000:3.0:1789672882.986842:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:6171:x1876607714225792:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789672882.986860:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672882.986880:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c9965312 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24fda expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672882.986909:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c9965312 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fda expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672882.986920:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c9965312 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fda expref: 13 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672882.986930:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887600, rc 0) 00000100:00100000:3.0:1789672882.987006:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:6171:x1876607714225792:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 165us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672882.987013:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 369 00000100:00100000:1.0:1789672882.991969:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672882.995563:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714225920 00000100:00100000:0.0:1789672882.995579:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714225920 00000100:00100000:0.0:1789672882.995641:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 370 00000100:00100000:0.0:1789672882.995651:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:6171:x1876607714225920:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789672882.995850:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:6171:x1876607714225920:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 199us (3903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672882.995859:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 370 00000100:00100000:0.0:1789672883.014913:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672883.015124:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714226048 00000100:00100000:3.0:1789672883.015134:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714226048 00000100:00100000:3.0:1789672883.015180:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 371 00000100:00100000:3.0:1789672883.015189:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:6171:x1876607714226048:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789672883.015326:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:6171:x1876607714226048:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 Request processed in 137us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672883.015334:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 371 00000100:00100000:1.0:1789672883.022079:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672883.022250:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714226176 00000100:00100000:3.0:1789672883.022265:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714226176 00000100:00100000:3.0:1789672883.022343:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 372 00000100:00100000:3.0:1789672883.022352:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:10803:x1876607714226176:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789672883.022515:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:10803:x1876607714226176:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 162us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672883.022535:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 372 00000100:00100000:1.0:1789672883.043220:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672883.043311:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714226304 00000100:00100000:3.0:1789672883.043322:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714226304 00000100:00100000:3.0:1789672883.043385:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 373 00000100:00100000:3.0:1789672883.043395:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:10803:x1876607714226304:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789672883.043524:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:10803:x1876607714226304:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 130us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672883.043532:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 373 00010000:00010000:2.0:1789672883.397589:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789672883.972941:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789672884.036761:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789672884.037087:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738435584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789672884.037190:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672884.037713:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738435584 00000100:00100000:0.0:1789672884.037724:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738435584 00000100:00100000:0.0:1789672884.037813:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789672884.037826:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738435584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789672884.037865:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672884.037927:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738435584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672884.037934:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1789672884.038013:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672884.038205:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738435584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789672884.038360:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789672884.038370:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738435712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672884.038423:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672884.038592:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738435712 00000100:00100000:2.0:1789672884.038598:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738435712 00000100:00100000:2.0:1789672884.038649:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789672884.038678:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876607738435712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789672884.038692:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672884.038728:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876607738435712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672884.038756:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1789672884.038935:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672884.039021:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738435712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789672884.420002:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672885.062702:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738435840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672885.062801:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672885.062999:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738435840 00000100:00100000:0.0:1789672885.063010:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738435840 00000100:00100000:0.0:1789672885.063077:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789672885.063088:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738435840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789672885.063143:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789672885.068151:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738435840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5048us (5333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672885.068172:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789672885.074930:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738435840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672885.200030:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672885.200081:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672885.200119:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672885.200234:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672885.200262:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672885.200314:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714226816 00000100:00100000:3.0:1789672885.200340:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714226816 00000100:00100000:3.0:1789672885.200457:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 87 00000100:00100000:3.0:1789672885.200470:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714226816:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672885.200567:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714226816:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 99us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672885.200604:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 87 00000100:00080000:3.0:1789672885.200632:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672885.200814:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714226432 00000100:00100000:3.0:1789672885.200819:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714226432 00000100:00100000:3.0:1789672885.200863:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 374 00000100:00100000:3.0:1789672885.200871:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2398:x1876607714226432:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672885.200905:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2398:x1876607714226432:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 35us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672885.200912:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 374 00000100:00100000:0.0:1789672885.231045:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714226560 00000100:00100000:0.0:1789672885.231069:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714226560 00000100:00100000:0.0:1789672885.231207:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714227072 00000100:00100000:0.0:1789672885.231212:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714227072 00000100:00100000:0.0:1789672885.231235:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714226688 00000100:00100000:0.0:1789672885.231238:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714226688 00000100:00100000:0.0:1789672885.231268:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 242 00000100:00100000:0.0:1789672885.231281:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714226560:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672885.231410:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714226560:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 131us (31394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672885.231419:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 242 00000100:00100000:0.0:1789672885.231481:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 243 00000100:00100000:0.0:1789672885.231488:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714227072:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672885.231520:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714227072:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 32us (31399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672885.231526:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 243 00000100:00100000:0.0:1789672885.231557:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 244 00000100:00100000:0.0:1789672885.231563:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714226688:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672885.231587:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714226688:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (31325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672885.231592:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 244 00000100:00080000:1.0:1789672885.233914:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789672885.233935:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672885.236929:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672885.237121:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714226944 00000100:00100000:3.0:1789672885.237135:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714226944 00000100:00100000:3.0:1789672885.237253:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 245 00000100:00100000:3.0:1789672885.237266:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714226944:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672885.237386:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714226944:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 122us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672885.237395:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 245 00000100:00080000:1.0:1789672885.237575:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789672885.444094:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672886.096863:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738435968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789672886.097004:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672886.097074:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738435968 00000100:00100000:2.0:1789672886.097091:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738435968 00000100:00100000:2.0:1789672886.097173:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789672886.097198:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738435968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789672886.097532:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789672886.097631:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738435968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 448us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672886.097641:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789672886.098617:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738435968:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789672886.470165:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789672887.112478:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:3.0:1789672887.502415:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672887.620314:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672887.620341:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738436096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672887.620417:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672887.620627:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738436096 00000100:00100000:3.0:1789672887.620636:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738436096 00000100:00100000:3.0:1789672887.620720:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789672887.620732:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738436096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789672887.620765:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672887.620825:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738436096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672887.620833:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789672887.620989:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738436352:0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.621021:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672887.621049:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738436864:0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.621072:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672887.621091:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738437376:0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.621111:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672887.621130:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789672887.621136:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738436480:0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.621158:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672887.621178:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738436992:0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.621199:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672887.621217:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738437504:0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.621237:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672887.621266:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738436480 00000100:00100000:3.0:1789672887.621271:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738436480 00000100:00100000:3.0:1789672887.621378:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789672887.621387:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738436480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.621429:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f60b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738436480:12345-0@lo:400:kworker.0 Request processed in 44us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672887.621436:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789672887.621456:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738436352 00000100:00100000:3.0:1789672887.621460:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738436352 00000100:00100000:3.0:1789672887.621478:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738436864 00000100:00100000:3.0:1789672887.621481:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738436864 00000100:00100000:3.0:1789672887.621495:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738437376 00000100:00100000:3.0:1789672887.621497:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738437376 00000100:00100000:3.0:1789672887.621511:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738436992 00000100:00100000:3.0:1789672887.621521:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738436992 00000100:00100000:3.0:1789672887.621537:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738437504 00000100:00100000:3.0:1789672887.621540:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738437504 00000100:00100000:3.0:1789672887.621556:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789672887.621563:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738436352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.621596:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738436352:12345-0@lo:400:kworker.0 Request processed in 33us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672887.621602:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789672887.621614:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789672887.621621:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f60ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738436864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.621647:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f60ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738436864:12345-0@lo:400:kworker.0 Request processed in 27us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672887.621653:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789672887.621689:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789672887.621697:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738437376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.621736:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738437376:12345-0@lo:400:kworker.0 Request processed in 40us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672887.621743:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789672887.621755:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789672887.621761:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738436992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.621788:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738436992:12345-0@lo:400:kworker.0 Request processed in 27us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672887.621794:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789672887.621805:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789672887.621812:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738437504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.621837:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738437504:12345-0@lo:400:kworker.0 Request processed in 26us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672887.621850:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789672887.621892:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738436480:0@lo:400:kworker.0 00010000:00080000:3.0:1789672887.621907:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb4744c380 x1876607738436992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672887.621917:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738436992:0@lo:400:kworker.0 00010000:00080000:3.0:1789672887.621927:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f60b800 x1876607738437504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672887.621937:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738437504:0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.621947:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738436352:0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.621956:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738436864:0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.621965:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f60b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738437376:0@lo:400:kworker.0 00000100:00100000:1.0:1789672887.622085:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738436224:0@lo:400:kworker.0 00000100:00100000:1.0:1789672887.622120:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672887.622163:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738436736:0@lo:400:kworker.0 00000100:00100000:1.0:1789672887.622186:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672887.622206:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f60bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738437248:0@lo:400:kworker.0 00000100:00100000:1.0:1789672887.622231:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789672887.622255:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47a2b800 x1876607738436096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672887.622270:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738436096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672887.622283:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789672887.622307:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738436608:0@lo:400:kworker.0 00000100:00100000:1.0:1789672887.622329:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672887.622346:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738437120:0@lo:400:kworker.0 00000100:00100000:1.0:1789672887.622366:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672887.622382:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738437632:0@lo:400:kworker.0 00000100:00100000:1.0:1789672887.622403:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672887.622429:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738436608 00000100:00100000:1.0:1789672887.622435:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738436608 00000100:00100000:1.0:1789672887.622462:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789672887.622469:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738436608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672887.622502:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738436608:12345-0@lo:400:kworker.0 Request processed in 34us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672887.622507:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789672887.622526:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738436736 00000100:00100000:1.0:1789672887.622530:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738436736 00000100:00100000:1.0:1789672887.622553:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789672887.622560:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738436736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672887.622599:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738436736:12345-0@lo:400:kworker.0 Request processed in 39us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672887.622605:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789672887.622623:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738437248 00000100:00100000:1.0:1789672887.622626:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738437248 00000100:00100000:1.0:1789672887.622651:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738437120 00000100:00100000:1.0:1789672887.622653:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738437120 00000100:00100000:1.0:1789672887.622692:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738437632 00000100:00100000:1.0:1789672887.622695:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738437632 00000100:00100000:1.0:1789672887.622711:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789672887.622717:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc818f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738437248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672887.622748:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc818f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738437248:12345-0@lo:400:kworker.0 Request processed in 31us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672887.622754:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789672887.622915:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789672887.622921:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738437120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672887.622948:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738437120:12345-0@lo:400:kworker.0 Request processed in 28us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672887.622954:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789672887.622966:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789672887.622972:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738437632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672887.622998:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738437632:12345-0@lo:400:kworker.0 Request processed in 26us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672887.623004:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1789672887.623038:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672887.623043:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789672887.623045:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789672887.623054:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789672887.623082:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738436608:0@lo:400:kworker.0 00000100:00100000:1.0:1789672887.623091:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738437120:0@lo:400:kworker.0 00010000:00080000:1.0:1789672887.623102:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f608a80 x1876607738437632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672887.623111:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738437632:0@lo:400:kworker.0 00000100:00100000:1.0:1789672887.623121:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738436736:0@lo:400:kworker.0 00000100:00100000:1.0:1789672887.623129:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789672887.623134:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfc4121aa00, transno 4294967301 00000100:00100000:1.0:1789672887.623143:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f60bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738437248:0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.624284:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738436224 00000100:00100000:3.0:1789672887.624343:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738436224 00000100:00100000:3.0:1789672887.624391:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789672887.624400:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45b8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738436224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672887.624512:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45b8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738436224:12345-0@lo:400:kworker.0 Request processed in 114us (2390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672887.624520:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789672887.625174:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789672887.625189:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738437760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789672887.625225:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672887.625440:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738436224:0@lo:400:kworker.0 00000100:00100000:2.0:1789672887.625492:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738437760 00000100:00100000:2.0:1789672887.625498:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738437760 00000100:00100000:2.0:1789672887.625576:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789672887.625585:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f60b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738437760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789672887.625601:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672887.625651:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f60b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738437760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672887.625678:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1789672887.625744:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f605180 x1876607738437760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672887.625782:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738437760:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789672888.515929:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672889.155989:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738437888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789672889.156061:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672889.156243:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738437888 00000100:00100000:2.0:1789672889.156251:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738437888 00000100:00100000:1.0:1789672889.156301:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738438016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672889.156330:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789672889.156344:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738437888:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789672889.156352:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789672889.156377:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672889.156394:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738438016 00000100:00100000:1.0:1789672889.156400:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738438016 00000100:00100000:2.0:1789672889.156432:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738437888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672889.156432:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789672889.156441:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738438016:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672889.156455:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789672889.156564:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738437888:0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789672889.156566:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672889.156612:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738438016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672889.156618:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1789672889.156683:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672889.156811:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738438016:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789672889.540710:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672890.182096:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738438144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789672890.182534:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672890.183825:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738438144 00000100:00100000:2.0:1789672890.183838:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738438144 00000100:00100000:2.0:1789672890.183941:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789672890.183952:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738438144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789672890.183994:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789672890.184072:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738438144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (1702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672890.184080:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789672890.184164:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738438144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789672890.328127:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672890.328176:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672890.328212:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672890.328254:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672890.328291:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672890.328330:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672890.328569:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714227456 00000100:00100000:1.0:1789672890.328580:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714227456 00000100:00100000:1.0:1789672890.328646:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714227712 00000100:00100000:1.0:1789672890.328650:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714227712 00000100:00100000:1.0:1789672890.328693:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714227328 00000100:00100000:1.0:1789672890.328706:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714227328 00000100:00100000:1.0:1789672890.328723:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714227840 00000100:00100000:1.0:1789672890.328725:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714227840 00000100:00100000:1.0:1789672890.328742:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 252 00000100:00100000:1.0:1789672890.328751:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714227456:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672890.328836:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714227456:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 85us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672890.328844:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 252 00000100:00100000:1.0:1789672890.328863:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 253 00000100:00100000:1.0:1789672890.328869:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714227712:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672890.328894:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714227712:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672890.328900:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 253 00000100:00100000:1.0:1789672890.328913:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 254 00000100:00100000:1.0:1789672890.328919:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714227328:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672890.328940:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714227328:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 22us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672890.328945:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 254 00000100:00100000:1.0:1789672890.328955:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 255 00000100:00100000:1.0:1789672890.328962:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714227840:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672890.328982:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714227840:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 21us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672890.328989:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 255 00000100:00100000:1.0:1789672890.329008:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714227584 00000100:00100000:1.0:1789672890.329017:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714227584 00000100:00100000:1.0:1789672890.329047:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 91 00000100:00100000:1.0:1789672890.329053:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714227584:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672890.329078:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714227584:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672890.329097:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 91 00000100:00080000:2.0:1789672890.330331:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789672890.330339:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789672890.330342:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789672890.331462:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714227200 00000100:00100000:3.0:1789672890.331474:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714227200 00000100:00100000:3.0:1789672890.331535:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 376 00000100:00100000:3.0:1789672890.331545:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714227200:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672890.331625:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714227200:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 81us (3509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672890.331633:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 376 00010000:00010000:3.0:1789672890.563921:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672891.205294:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738438272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789672891.205395:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672891.205763:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738438272 00000100:00100000:3.0:1789672891.205773:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738438272 00000100:00100000:3.0:1789672891.205828:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789672891.205837:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738438272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789672891.205872:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789672891.205921:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738438272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672891.205929:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789672891.206053:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738438272:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789672891.589226:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672892.626474:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672892.740004:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789672892.740027:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738438400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672892.740101:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672892.740178:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738438400 00000100:00100000:1.0:1789672892.740186:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738438400 00000100:00100000:1.0:1789672892.740248:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789672892.740258:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738438400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789672892.740301:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672892.740589:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738438400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 331us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672892.740596:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1789672892.740619:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789672892.740649:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb479d0000 x1876607738438400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672892.740695:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738438400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672892.740810:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672892.740819:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738438528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789672892.740851:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672892.740882:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738438528 00000100:00100000:0.0:1789672892.740886:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738438528 00000100:00100000:0.0:1789672892.740912:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789672892.740918:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738438528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789672892.740928:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672892.740969:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738438528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672892.740974:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:0.0:1789672892.741010:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f603b80 x1876607738438528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672892.741023:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738438528:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789672892.741120:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789672892.746600:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738438784:0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.746692:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672892.746744:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738439296:0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.746768:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672892.746790:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738439808:0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.746811:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672892.746835:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789672892.746840:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738438656:0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.746869:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672892.746890:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738439168:0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.746914:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672892.746933:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738439680:0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.746955:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672892.746983:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738439040:0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.747005:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672892.747021:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738439552:0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.747039:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672892.747057:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789672892.747062:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738438912:0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.747084:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672892.747100:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738439424:0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.747119:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672892.747135:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876607738439936:0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.747152:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672892.747188:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738438784 00000100:00100000:1.0:1789672892.747205:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738438784 00000100:00100000:1.0:1789672892.747241:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738439296 00000100:00100000:1.0:1789672892.747243:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738439296 00000100:00100000:1.0:1789672892.747263:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738439808 00000100:00100000:1.0:1789672892.747265:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738439808 00000100:00100000:1.0:1789672892.747274:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738439040 00000100:00100000:1.0:1789672892.747276:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738439040 00000100:00100000:1.0:1789672892.747284:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738439424 00000100:00100000:1.0:1789672892.747286:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738439424 00000100:00100000:1.0:1789672892.747297:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738439936 00000100:00100000:1.0:1789672892.747299:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738439936 00000100:00100000:1.0:1789672892.747312:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789672892.747319:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738438784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.747582:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738438784:12345-0@lo:400:kworker.0 Request processed in 261us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672892.747589:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789672892.747606:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789672892.747613:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738439296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.747638:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738439296:12345-0@lo:400:kworker.0 Request processed in 27us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672892.747644:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789672892.747715:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738438784:0@lo:400:kworker.0 00000100:00100000:0.0:1789672892.747727:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738439296:0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.747839:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789672892.747846:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738439808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.748408:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738439808:12345-0@lo:400:kworker.0 Request processed in 560us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672892.748415:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789672892.748428:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789672892.748434:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738439040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.748474:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738439040:12345-0@lo:400:kworker.0 Request processed in 40us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672892.748479:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789672892.748489:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789672892.748495:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738439424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.748515:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738439424:12345-0@lo:400:kworker.0 Request processed in 21us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672892.748521:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789672892.748529:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789672892.748535:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876607738439936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.748554:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876607738439936:12345-0@lo:400:kworker.0 Request processed in 20us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672892.748559:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789672892.748582:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738438656 00000100:00100000:1.0:1789672892.748587:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738438656 00000100:00100000:1.0:1789672892.748611:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789672892.748617:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738438656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.748643:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738438656:12345-0@lo:400:kworker.0 Request processed in 27us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672892.748649:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789672892.748690:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738439168 00000100:00100000:1.0:1789672892.748693:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738439168 00000100:00100000:1.0:1789672892.748829:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738438912 00000100:00100000:1.0:1789672892.748832:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738438912 00000100:00100000:1.0:1789672892.748845:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789672892.748850:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738439168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.748887:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738439168:12345-0@lo:400:kworker.0 Request processed in 36us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672892.748893:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789672892.748902:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789672892.748907:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738438912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.748927:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738438912:12345-0@lo:400:kworker.0 Request processed in 20us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672892.748932:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789672892.748947:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738439680 00000100:00100000:1.0:1789672892.748961:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738439680 00000100:00100000:1.0:1789672892.748984:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738439552 00000100:00100000:1.0:1789672892.748986:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738439552 00000100:00100000:1.0:1789672892.749000:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789672892.749006:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738439680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.749030:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738439680:12345-0@lo:400:kworker.0 Request processed in 25us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672892.749036:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789672892.749044:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789672892.749049:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738439552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.749071:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738439552:12345-0@lo:400:kworker.0 Request processed in 22us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672892.749076:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1789672892.749101:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672892.749105:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789672892.749108:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672892.749128:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738438912:0@lo:400:kworker.0 00010000:00080000:1.0:1789672892.749148:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8cb100 x1876607738439424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672892.749159:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738439424:0@lo:400:kworker.0 00010000:00080000:1.0:1789672892.749169:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d868a80 x1876607738439936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672892.749177:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876607738439936:0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.749186:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738439040:0@lo:400:kworker.0 00000100:00100000:1.0:1789672892.749202:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738439552:0@lo:400:kworker.0 00000100:00100000:0.0:1789672892.757867:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738439808:0@lo:400:kworker.0 00000100:00100000:0.0:1789672892.757901:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738438656:0@lo:400:kworker.0 00000100:00100000:0.0:1789672892.757914:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738439168:0@lo:400:kworker.0 00000100:00100000:0.0:1789672892.757926:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738439680:0@lo:400:kworker.0 00000040:00080000:0.0:1789672893.188655:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789672893.635918:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789672894.276476:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789672894.276983:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738440192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672894.277050:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672894.277224:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738440192 00000100:00100000:1.0:1789672894.277233:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738440192 00000100:00100000:1.0:1789672894.277296:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789672894.277316:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738440192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672894.277345:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672894.277390:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738440192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672894.277396:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789672894.277440:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738440192:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789672894.277548:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672894.277596:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672894.277607:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738440064:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789672894.277638:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672894.277835:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738440064 00000100:00100000:1.0:1789672894.277840:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738440064 00000100:00100000:1.0:1789672894.277883:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789672894.277891:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738440064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789672894.277901:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672894.277946:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738440064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672894.277967:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789672894.277996:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738440064:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789672894.278088:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789672894.661768:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672895.304894:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789672895.304917:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738440320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672895.304995:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672895.306959:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738440320 00000100:00100000:2.0:1789672895.306973:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738440320 00000100:00100000:2.0:1789672895.307057:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789672895.307068:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738440320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789672895.307103:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789672895.307197:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738440320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (2201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672895.307204:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789672895.308588:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738440320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789672895.443299:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672895.443359:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672895.443400:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672895.443563:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714228224 00000100:00100000:0.0:1789672895.443576:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714228224 00000100:00100000:0.0:1789672895.443646:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714228096 00000100:00100000:0.0:1789672895.443649:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714228096 00000100:00100000:0.0:1789672895.443708:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 262 00000100:00100000:0.0:1789672895.443718:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714228224:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672895.443799:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714228224:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 82us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672895.443807:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 262 00000100:00100000:0.0:1789672895.443841:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 263 00000100:00100000:0.0:1789672895.443848:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714228096:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672895.443875:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714228096:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672895.443899:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 263 00000100:00080000:2.0:1789672895.444278:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789672895.444282:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789672895.444354:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714227968 00000100:00100000:1.0:1789672895.444361:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714227968 00000100:00100000:1.0:1789672895.444400:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 378 00000100:00100000:1.0:1789672895.444407:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714227968:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672895.444448:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714227968:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 42us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672895.444455:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 378 00000100:00100000:2.0:1789672895.464802:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672895.464857:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672895.464908:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672895.465053:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714228480 00000100:00100000:3.0:1789672895.465067:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714228480 00000100:00100000:3.0:1789672895.465170:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714228608 00000100:00100000:3.0:1789672895.465174:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714228608 00000100:00100000:3.0:1789672895.465201:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 264 00000100:00100000:3.0:1789672895.465213:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714228480:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672895.465326:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714228480:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 116us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672895.465357:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 264 00000100:00100000:3.0:1789672895.465377:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 265 00000100:00100000:3.0:1789672895.465384:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714228608:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672895.465413:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714228608:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 30us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672895.465419:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 265 00000100:00080000:3.0:1789672895.465442:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789672895.465447:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672895.466624:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714228352 00000100:00100000:1.0:1789672895.466641:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714228352 00000100:00100000:1.0:1789672895.466765:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:1.0:1789672895.466776:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2394:x1876607714228352:12345-192.168.201.50@tcp:9:kworker.0 00000020:00000080:1.0:1789672895.466813:0:8494:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9965239 00000100:00080000:1.0:1789672895.466825:0:8494:0:(import.c:65:import_set_state_nolock()) ffff8cfb47a6d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789672895.466885:0:8494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1789672895.467504:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+2:2394:x1876607714228352:12345-192.168.201.50@tcp:9:kworker.0 Request processed in 728us (2714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672895.467516:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 27 00010000:00010000:0.0:1789672895.467742:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789672895.468788:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789672895.685436:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672896.329435:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672896.329466:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738440448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789672896.329557:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672896.329679:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738440448 00000100:00100000:3.0:1789672896.329689:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738440448 00000100:00100000:3.0:1789672896.329747:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789672896.329758:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738440448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789672896.329803:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789672896.329855:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f60a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738440448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672896.329862:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789672896.329928:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738440448:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789672896.708370:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672897.732008:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672897.859924:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738440576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789672897.860016:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672897.860323:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738440576 00000100:00100000:1.0:1789672897.860339:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738440576 00000100:00100000:1.0:1789672897.860420:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789672897.860451:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f60b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738440576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789672897.860494:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672897.860701:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672897.860718:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738440704:0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.860766:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672897.860855:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738440832:0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.860886:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672897.861071:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738440704 00000100:00100000:0.0:1789672897.861082:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738440704 00000100:00100000:0.0:1789672897.861147:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789672897.861157:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738440704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672897.861236:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738440704:12345-0@lo:400:kworker.0 Request processed in 80us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672897.861242:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1789672897.866250:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738441088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672897.866591:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672897.872560:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f60b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738440576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 12098us (12530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672897.872580:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789672897.873212:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738440704:0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.873729:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672897.873751:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738441216:0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.873826:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672897.873894:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738441344:0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.873924:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672897.873987:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738441344 00000100:00100000:2.0:1789672897.873996:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738441344 00000100:00100000:2.0:1789672897.874053:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789672897.874062:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738441344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.874132:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738441344:12345-0@lo:400:kworker.0 Request processed in 71us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672897.874140:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789672897.874179:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738441344:0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.875813:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672897.875834:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738441728:0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.875912:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672897.879534:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738441856:0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.879774:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789672897.879849:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb479d0000 x1876607738440576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672897.879879:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738440576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789672897.879917:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738441600:0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.879964:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738441728 00000100:00100000:2.0:1789672897.879977:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738441728 00000100:00100000:2.0:1789672897.880039:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738441856 00000100:00100000:2.0:1789672897.880043:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738441856 00000100:00100000:2.0:1789672897.880069:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789672897.880080:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738441728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.880163:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738441728:12345-0@lo:400:kworker.0 Request processed in 83us (4249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672897.880174:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789672897.880216:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789672897.880223:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672897.880233:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738441856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672897.880274:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789672897.880283:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738441856:12345-0@lo:400:kworker.0 Request processed in 52us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672897.880288:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738440960:0@lo:400:kworker.0 00000100:00100000:3.0:1789672897.880320:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672897.880925:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738440832 00000100:00100000:3.0:1789672897.881138:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876607738441472:0@lo:400:kworker.0 00000100:00100000:3.0:1789672897.881167:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672897.881195:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738441088 00000100:00100000:3.0:1789672897.881199:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738441088 00000100:00100000:3.0:1789672897.881246:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789672897.881254:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f60a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738441088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789672897.881275:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672897.881311:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f60a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738441088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (14722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672897.881317:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789672897.881348:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738441216 00000100:00100000:3.0:1789672897.881351:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738441216 00000100:00100000:0.0:1789672897.881770:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738440832 00000100:00100000:0.0:1789672897.881808:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738441600 00000100:00100000:0.0:1789672897.881811:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738441600 00000100:00100000:0.0:1789672897.881823:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738441472 00000100:00100000:0.0:1789672897.881825:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738441472 00000100:00100000:0.0:1789672897.881837:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789672897.881843:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738440832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672897.881879:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738440832:12345-0@lo:400:kworker.0 Request processed in 37us (20993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672897.881886:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789672897.881908:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789672897.881913:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738441600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672897.881933:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738441600:12345-0@lo:400:kworker.0 Request processed in 21us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672897.882599:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789672897.882607:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876607738441472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672897.882646:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876607738441472:12345-0@lo:400:kworker.0 Request processed in 41us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672897.882678:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789672897.882773:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789672897.883073:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789672897.883081:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738441216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672897.883123:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738441216:12345-0@lo:400:kworker.0 Request processed in 43us (9298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672897.883129:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:3.0:1789672897.883159:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789672897.883163:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789672897.883166:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789672897.883169:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789672897.883232:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789672897.883234:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876607738441472:0@lo:400:kworker.0 00010000:00080000:3.0:1789672897.883253:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47ac3100 x1876607738441600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672897.883266:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738441600:0@lo:400:kworker.0 00010000:00080000:3.0:1789672897.883279:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb479d3800 x1876607738441088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672897.883295:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738441088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672897.883334:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738440960 00000100:00100000:2.0:1789672897.883346:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738440960 00000100:00100000:2.0:1789672897.883399:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789672897.883423:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738440960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.883516:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738440960:12345-0@lo:400:kworker.0 Request processed in 96us (3195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672897.883524:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789672897.883571:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738440960:0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.883652:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789672897.883686:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876607738441984:0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.883727:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672897.883768:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738441856:0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.883790:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876607738442112:0@lo:400:kworker.0 00000100:00100000:3.0:1789672897.883801:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738441728:0@lo:400:kworker.0 00000100:00100000:3.0:1789672897.883820:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738441216:0@lo:400:kworker.0 00000100:00100000:3.0:1789672897.883832:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738440832:0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.883843:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672897.883877:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738441984 00000100:00100000:3.0:1789672897.883895:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738441984 00000100:00100000:2.0:1789672897.883915:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738442112 00000100:00100000:2.0:1789672897.883921:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738442112 00000100:00100000:2.0:1789672897.885390:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789672897.885414:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876607738441984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.885515:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876607738441984:12345-0@lo:400:kworker.0 Request processed in 112us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672897.885523:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789672897.885550:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789672897.885559:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876607738442112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.885593:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876607738442112:12345-0@lo:400:kworker.0 Request processed in 38us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672897.885599:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00080000:2.0:1789672897.885652:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f606d80 x1876607738442112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672897.885701:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876607738442112:0@lo:400:kworker.0 00000100:00100000:2.0:1789672897.885718:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876607738441984:0@lo:400:kworker.0 00000100:00080000:2.0:1789672897.885772:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789672897.885777:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789672898.758577:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672899.396166:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738442240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672899.396312:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672899.396425:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672899.396436:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738442368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789672899.396460:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738442240 00000100:00100000:0.0:1789672899.396472:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672899.396473:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738442240 00000100:00080000:0.0:1789672899.396547:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672899.396588:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738442368 00000100:00100000:2.0:1789672899.396593:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738442368 00000100:00100000:0.0:1789672899.396609:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1789672899.396629:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672899.396686:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789672899.396694:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738442240:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672899.396704:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738442368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789672899.396742:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672899.396836:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738442368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 140us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672899.396844:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789672899.396956:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46801f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738442368:0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789672899.396991:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672899.397050:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738442240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 427us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672899.397058:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789672899.397143:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738442240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789672899.782955:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672900.420141:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738442496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789672900.420265:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672900.420922:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738442496 00000100:00100000:2.0:1789672900.420936:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738442496 00000100:00100000:2.0:1789672900.421002:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789672900.421012:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738442496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789672900.421065:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789672900.421144:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738442496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672900.421152:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789672900.421259:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738442496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789672900.560805:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672900.560877:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672900.560911:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672900.561020:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714228736 00000100:00100000:1.0:1789672900.561033:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714228736 00000100:00100000:1.0:1789672900.561122:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 380 00000100:00100000:2.0:1789672900.561160:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672900.561250:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2395:x1876607714228736:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672900.561345:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2395:x1876607714228736:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 98us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672900.561354:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 380 00000100:00100000:2.0:1789672900.572534:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672900.573210:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714228992 00000100:00100000:0.0:1789672900.573226:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714228992 00000100:00100000:0.0:1789672900.574958:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714229248 00000100:00100000:0.0:1789672900.574975:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714229248 00000100:00100000:0.0:1789672900.575027:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714228864 00000100:00100000:0.0:1789672900.575031:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714228864 00000100:00100000:0.0:1789672900.575070:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 272 00000100:00100000:0.0:1789672900.576951:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2395:x1876607714228992:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672900.577110:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2395:x1876607714228992:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 2028us (16231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672900.577123:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 272 00000100:00100000:0.0:1789672900.577224:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 273 00000100:00100000:0.0:1789672900.577238:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2395:x1876607714229248:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672900.577269:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2395:x1876607714229248:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 36us (16357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672900.577276:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 273 00000100:00100000:0.0:1789672900.577291:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 274 00000100:00100000:0.0:1789672900.577299:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2395:x1876607714228864:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672900.577328:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2395:x1876607714228864:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 29us (16166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672900.577334:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 274 00000100:00080000:0.0:1789672900.577382:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672900.577390:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789672900.588179:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714229120 00000100:00100000:0.0:1789672900.588206:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714229120 00000100:00100000:0.0:1789672900.588332:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 275 00000100:00100000:0.0:1789672900.588346:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2395:x1876607714229120:12345-192.168.201.50@tcp:400:kworker.0 00000100:00080000:2.0:1789672900.588444:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672900.588477:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2395:x1876607714229120:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 134us (15958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672900.588485:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 275 00010000:00010000:0.0:1789672900.811795:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789672900.944716:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000020:00000080:2.0:1789672900.944729:0:8423:0:(genops.c:885:class_export_put()) final put ffff8cfb47a6a000/ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000020:00000080:3.0:1789672900.944956:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb47a6a000/ad795a16-0aa4-4e04-82a0-6f12aab5f2ea for lustre-OST0000 00000020:00000080:3.0:1789672900.945034:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb47a6d800 for lustre-OST0000 00000100:00100000:1.0:1789672901.444079:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672901.444110:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738442624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789672901.444190:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672901.449541:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738442624 00000100:00100000:2.0:1789672901.449557:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738442624 00000100:00100000:2.0:1789672901.449624:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789672901.449632:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738442624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789672901.449700:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789672901.449783:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738442624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (5594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672901.449788:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789672901.449941:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738442624:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789672901.831199:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672902.852811:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672902.983155:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738442880:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.983234:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672902.983288:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738443392:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.983320:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672902.983338:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738443904:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.983359:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672902.983384:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789672902.983389:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738442752:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.983440:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672902.983462:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738443264:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.983487:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672902.983504:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738443776:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.983524:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672902.983544:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738444288:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.983564:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672902.983592:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738443008:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.983613:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672902.983630:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738443520:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.983650:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672902.983695:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738444032:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.983717:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672902.983736:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789672902.983742:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738443136:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.983775:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672902.983786:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738443648:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.983806:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672902.983823:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4793b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738444160:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.983855:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672902.983892:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738442880 00000100:00100000:1.0:1789672902.983900:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738442880 00000100:00100000:1.0:1789672902.983941:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738443392 00000100:00100000:1.0:1789672902.983945:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738443392 00000100:00100000:1.0:1789672902.983971:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738443904 00000100:00100000:1.0:1789672902.983980:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738443904 00000100:00100000:1.0:1789672902.983999:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738443520 00000100:00100000:1.0:1789672902.984001:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738443520 00000100:00100000:1.0:1789672902.984025:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738444032 00000100:00100000:1.0:1789672902.984028:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738444032 00000100:00100000:1.0:1789672902.984041:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738443136 00000100:00100000:1.0:1789672902.984044:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738443136 00000100:00100000:1.0:1789672902.984059:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789672902.984069:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738442880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.984126:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738442880:12345-0@lo:400:kworker.0 Request processed in 58us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672902.984132:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789672902.984151:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789672902.984158:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738443392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.984184:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738443392:12345-0@lo:400:kworker.0 Request processed in 27us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672902.984190:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789672902.984202:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789672902.984208:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738443904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.984234:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738443904:12345-0@lo:400:kworker.0 Request processed in 26us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672902.984239:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789672902.984251:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789672902.984257:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738443520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.984286:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738443520:12345-0@lo:400:kworker.0 Request processed in 30us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672902.984292:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789672902.984310:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789672902.984315:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738444032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.984343:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738444032:12345-0@lo:400:kworker.0 Request processed in 28us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672902.984348:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789672902.984359:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789672902.984364:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738443136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.984385:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738443136:12345-0@lo:400:kworker.0 Request processed in 21us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672902.984390:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789672902.984415:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738442752 00000100:00100000:1.0:1789672902.984419:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738442752 00000100:00100000:1.0:1789672902.984444:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1789672902.984451:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738442752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.984478:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738442752:12345-0@lo:400:kworker.0 Request processed in 28us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672902.984484:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1789672902.984510:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738443264 00000100:00100000:1.0:1789672902.984514:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738443264 00000100:00100000:1.0:1789672902.984536:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738443008 00000100:00100000:1.0:1789672902.984539:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738443008 00000100:00100000:1.0:1789672902.984551:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789672902.984557:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738443264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.984590:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738443264:12345-0@lo:400:kworker.0 Request processed in 33us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672902.984597:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789672902.984607:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789672902.984619:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738443008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.984649:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738443008:12345-0@lo:400:kworker.0 Request processed in 30us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672902.984682:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789672902.984702:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738443776 00000100:00100000:1.0:1789672902.984706:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738443776 00000100:00100000:1.0:1789672902.984724:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738444288 00000100:00100000:1.0:1789672902.984726:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738444288 00000100:00100000:1.0:1789672902.984737:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738443648 00000100:00100000:1.0:1789672902.984739:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738443648 00000100:00100000:1.0:1789672902.984750:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738444160 00000100:00100000:1.0:1789672902.984752:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738444160 00000100:00100000:1.0:1789672902.984763:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789672902.984769:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738443776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.984800:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738443776:12345-0@lo:400:kworker.0 Request processed in 31us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672902.984805:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789672902.984816:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789672902.984821:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738444288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.984847:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738444288:12345-0@lo:400:kworker.0 Request processed in 25us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672902.984853:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789672902.984880:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789672902.984888:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738443648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.984916:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738443648:12345-0@lo:400:kworker.0 Request processed in 31us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672902.984922:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789672902.984940:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789672902.984945:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738444160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.984972:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738444160:12345-0@lo:400:kworker.0 Request processed in 28us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672902.984978:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1789672902.985024:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789672902.985029:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672902.985032:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789672902.985034:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672902.985077:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738443136:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.985089:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738443648:0@lo:400:kworker.0 00010000:00080000:1.0:1789672902.985102:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb4793b100 x1876607738444160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672902.985113:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4793b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738444160:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.985124:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738443008:0@lo:400:kworker.0 00010000:00080000:1.0:1789672902.985133:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8cb100 x1876607738443520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672902.985141:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738443520:0@lo:400:kworker.0 00010000:00080000:1.0:1789672902.985150:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47938000 x1876607738444032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672902.985159:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738444032:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.985198:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738442752:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.985208:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738443264:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.985227:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738443776:0@lo:400:kworker.0 00010000:00080000:1.0:1789672902.985236:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc4121aa00 x1876607738444288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672902.985245:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738444288:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.985256:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738442880:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.985266:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738443392:0@lo:400:kworker.0 00000100:00100000:1.0:1789672902.985274:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738443904:0@lo:400:kworker.0 00000100:00100000:0.0:1789672902.990419:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672902.990444:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738444416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672902.990525:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672902.990578:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738444416 00000100:00100000:0.0:1789672902.990598:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738444416 00000100:00100000:0.0:1789672902.990687:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789672902.990697:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738444416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672902.990732:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672902.992001:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738444416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1295us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672902.992026:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:0.0:1789672902.992105:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f603b80 x1876607738444416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672902.992132:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738444416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672902.997297:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672902.997339:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738444544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789672902.997446:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672902.997518:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738444544 00000100:00100000:3.0:1789672902.997528:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738444544 00000100:00100000:3.0:1789672902.997585:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789672902.997594:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738444544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789672902.997624:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672902.997701:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738444544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672902.997709:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:3.0:1789672902.997756:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47985c00 x1876607738444544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672902.997778:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738444544:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1789672903.428617:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789672903.880536:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672904.516457:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738444672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789672904.516548:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789672904.519894:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789672904.519971:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672904.519999:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738444800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672904.520069:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672904.520676:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738444672 00000100:00100000:1.0:1789672904.520687:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738444672 00000100:00100000:1.0:1789672904.520739:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738444800 00000100:00100000:1.0:1789672904.520742:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738444800 00000100:00100000:1.0:1789672904.520762:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789672904.520771:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738444672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789672904.520800:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672904.520852:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738444672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (4303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672904.520860:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789672904.520877:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789672904.520883:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738444800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672904.520892:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672904.520916:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738444800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672904.520922:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1789672904.520949:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672904.523721:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f60aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738444672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789672904.525433:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738444800:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789672904.908380:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672905.539833:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738444928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789672905.539932:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672905.540126:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738444928 00000100:00100000:1.0:1789672905.540136:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738444928 00000100:00100000:1.0:1789672905.540191:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789672905.540202:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738444928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789672905.540253:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789672905.540304:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f60aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738444928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672905.540311:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789672905.540354:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738444928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789672905.682558:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672905.682607:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672905.682629:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672905.682649:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672905.682867:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672905.682987:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714229504 00000100:00100000:1.0:1789672905.682998:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714229504 00000100:00100000:1.0:1789672905.683199:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714229760 00000100:00100000:1.0:1789672905.683204:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714229760 00000100:00100000:1.0:1789672905.683220:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714229632 00000100:00100000:1.0:1789672905.683223:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714229632 00000100:00100000:1.0:1789672905.683236:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714229888 00000100:00100000:1.0:1789672905.683238:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714229888 00000100:00100000:1.0:1789672905.683255:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 282 00000100:00100000:1.0:1789672905.683264:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2395:x1876607714229504:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672905.683342:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2395:x1876607714229504:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 78us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672905.683350:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 282 00000100:00100000:1.0:1789672905.683367:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 283 00000100:00100000:1.0:1789672905.683375:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2395:x1876607714229760:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672905.683401:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2395:x1876607714229760:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 27us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672905.683419:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 283 00000100:00100000:1.0:1789672905.683432:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 284 00000100:00100000:1.0:1789672905.683438:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714229632:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672905.683463:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714229632:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672905.683470:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 284 00000100:00100000:1.0:1789672905.683482:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 285 00000100:00100000:1.0:1789672905.683488:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714229888:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672905.683513:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714229888:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672905.683519:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 285 00000100:00100000:1.0:1789672905.683538:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714229376 00000100:00100000:1.0:1789672905.683542:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714229376 00000100:00100000:1.0:1789672905.683568:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 382 00000100:00100000:1.0:1789672905.683575:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2396:x1876607714229376:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672905.683599:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2396:x1876607714229376:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672905.683606:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 382 00000100:00080000:2.0:1789672905.683775:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789672905.683784:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789672905.923837:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672906.564100:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738445056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789672906.564183:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672906.564258:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738445056 00000100:00100000:0.0:1789672906.564266:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738445056 00000100:00100000:0.0:1789672906.564322:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789672906.564331:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738445056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789672906.564367:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789672906.564412:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738445056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672906.564419:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789672906.564462:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738445056:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789672906.949361:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672907.971976:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672908.101580:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738445184:0@lo:400:kworker.0 00000100:00100000:0.0:1789672908.101685:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672908.102358:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738445696:0@lo:400:kworker.0 00000100:00100000:0.0:1789672908.102407:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672908.102436:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f620a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738446208:0@lo:400:kworker.0 00000100:00100000:0.0:1789672908.102459:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672908.102476:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738446720:0@lo:400:kworker.0 00000100:00100000:0.0:1789672908.102496:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672908.102520:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789672908.102527:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738445568:0@lo:400:kworker.0 00000100:00100000:0.0:1789672908.102551:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672908.102567:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738446080:0@lo:400:kworker.0 00000100:00100000:0.0:1789672908.102587:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672908.102603:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738446592:0@lo:400:kworker.0 00000100:00100000:0.0:1789672908.102620:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672908.102651:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738445312:0@lo:400:kworker.0 00000100:00100000:0.0:1789672908.102695:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672908.102838:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738446208 00000100:00100000:2.0:1789672908.102846:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738446208 00000100:00100000:2.0:1789672908.102886:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738446720 00000100:00100000:2.0:1789672908.102888:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738446720 00000100:00100000:2.0:1789672908.102899:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738446080 00000100:00100000:2.0:1789672908.102901:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738446080 00000100:00100000:2.0:1789672908.102911:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738446592 00000100:00100000:2.0:1789672908.102914:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738446592 00000100:00100000:2.0:1789672908.102941:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789672908.102950:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738446208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672908.103833:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f5ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738445440:0@lo:400:kworker.0 00000100:00100000:2.0:1789672908.109982:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738446208:12345-0@lo:400:kworker.0 Request processed in 7023us (7511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672908.109999:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789672908.110039:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789672908.110051:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738446720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672908.110106:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738446720:12345-0@lo:400:kworker.0 Request processed in 60us (7609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672908.110112:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789672908.110124:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789672908.110131:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f621880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738446080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672908.110180:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f621880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738446080:12345-0@lo:400:kworker.0 Request processed in 49us (7591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672908.110187:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789672908.110199:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789672908.110207:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738446592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672908.110412:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738446592:12345-0@lo:400:kworker.0 Request processed in 205us (7789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672908.110425:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1789672908.110451:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789672908.110457:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672908.110845:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f623800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738446080:0@lo:400:kworker.0 00010000:00080000:2.0:1789672908.110860:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f621500 x1876607738446592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672908.110872:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738446592:0@lo:400:kworker.0 00000100:00100000:2.0:1789672908.110883:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f620a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738446208:0@lo:400:kworker.0 00010000:00080000:2.0:1789672908.110894:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f623480 x1876607738446720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789672924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672908.110902:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738446720:0@lo:400:kworker.0 00000100:00100000:1.0:1789672908.112868:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672908.112916:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738445952:0@lo:400:kworker.0 00000100:00100000:1.0:1789672908.112964:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672908.112991:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876607738446464:0@lo:400:kworker.0 00000100:00100000:1.0:1789672908.113022:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672908.113052:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672908.113059:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738446848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672908.113079:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672908.113109:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738445184 00000100:00100000:1.0:1789672908.113118:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738445184 00000100:00100000:1.0:1789672908.113168:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789672908.113177:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc66fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3636:x1876607738445184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672908.113222:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc66fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3636:x1876607738445184:12345-0@lo:400:kworker.0 Request processed in 47us (11537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672908.113228:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789672908.113276:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738445568 00000100:00100000:1.0:1789672908.113279:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738445568 00000100:00100000:1.0:1789672908.113302:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738445312 00000100:00100000:1.0:1789672908.113304:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738445312 00000100:00100000:1.0:1789672908.113313:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738445952 00000100:00100000:1.0:1789672908.113315:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738445952 00000100:00100000:1.0:1789672908.113333:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738446464 00000100:00100000:1.0:1789672908.113335:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738446464 00000100:00100000:1.0:1789672908.113347:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789672908.113352:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738445568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672908.113379:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738445568:12345-0@lo:400:kworker.0 Request processed in 27us (10827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672908.113384:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789672908.113393:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789672908.113398:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738445312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672908.113418:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738445312:12345-0@lo:400:kworker.0 Request processed in 21us (10723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672908.113429:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789672908.113438:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789672908.113443:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738445952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672908.113469:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738445952:12345-0@lo:400:kworker.0 Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672908.113474:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789672908.113483:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789672908.113488:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876607738446464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672908.113507:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876607738446464:12345-0@lo:400:kworker.0 Request processed in 20us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672908.113513:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789672908.113564:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738446848 00000100:00100000:1.0:1789672908.113567:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738446848 00000100:00100000:1.0:1789672908.113586:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789672908.113592:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738446848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789672908.113611:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672908.113638:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738446848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672908.113643:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1789672908.113687:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789672908.114226:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738446976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789672908.114321:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789672908.114361:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc4cd40700 x1876607738446848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672908.114380:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738446848:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789672908.114407:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f623100 x1876607738445952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672908.114415:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738445952:0@lo:400:kworker.0 00010000:00080000:1.0:1789672908.114425:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f622d80 x1876607738446464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672908.114432:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876607738446464:0@lo:400:kworker.0 00000100:00100000:1.0:1789672908.114468:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738446976 00000100:00100000:1.0:1789672908.114473:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738446976 00000100:00100000:1.0:1789672908.114499:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789672908.114505:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738446976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789672908.114519:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672908.114553:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738446976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672908.114560:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:1.0:1789672908.114583:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47987800 x1876607738446976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789672924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672908.114596:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738446976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789672908.117299:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738445696 00000100:00100000:2.0:1789672908.117313:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738445696 00000100:00100000:2.0:1789672908.117355:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738445440 00000100:00100000:2.0:1789672908.117358:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738445440 00000100:00100000:2.0:1789672908.117373:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789672908.117382:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738445696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672908.117462:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738445696:12345-0@lo:400:kworker.0 Request processed in 82us (15055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672908.117469:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789672908.117484:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789672908.117489:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738445440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672908.117517:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738445440:12345-0@lo:400:kworker.0 Request processed in 28us (4655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672908.117538:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789672908.117590:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738445440:0@lo:400:kworker.0 00000100:00100000:2.0:1789672908.117622:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738445568:0@lo:400:kworker.0 00000100:00100000:2.0:1789672908.117631:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738445184:0@lo:400:kworker.0 00000100:00100000:2.0:1789672908.117641:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738445696:0@lo:400:kworker.0 00000100:00100000:0.0:1789672908.123882:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f5aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738445312:0@lo:400:kworker.0 00000100:00100000:0.0:1789672908.123900:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738445824:0@lo:400:kworker.0 00000100:00100000:0.0:1789672908.123992:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672908.124033:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738446336:0@lo:400:kworker.0 00000100:00100000:0.0:1789672908.124058:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672908.124291:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738445824 00000100:00100000:1.0:1789672908.124299:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738445824 00000100:00100000:1.0:1789672908.124354:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738446336 00000100:00100000:1.0:1789672908.124357:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738446336 00000100:00100000:1.0:1789672908.124381:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789672908.124390:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738445824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672908.124447:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738445824:12345-0@lo:400:kworker.0 Request processed in 59us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672908.124471:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789672908.124488:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789672908.124494:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738446336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672908.124523:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738446336:12345-0@lo:400:kworker.0 Request processed in 30us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672908.124529:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00080000:1.0:1789672908.124553:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672908.126641:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738445824:0@lo:400:kworker.0 00000100:00100000:0.0:1789672908.126690:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738446336:0@lo:400:kworker.0 00000001:02000400:2.0:1789672908.496263:0:14058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 15:21:45 (1789672905) 00010000:00010000:3.0:1789672908.998386:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672909.635909:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f60bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738447104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789672909.636012:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672909.636326:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738447104 00000100:00100000:3.0:1789672909.636337:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738447104 00000100:00100000:3.0:1789672909.636393:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789672909.636402:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738447104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789672909.636434:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672909.636494:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738447104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672909.636501:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789672909.636546:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f60bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738447104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789672909.637040:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672909.637050:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738447232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672909.637091:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672909.637129:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738447232 00000100:00100000:0.0:1789672909.637133:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738447232 00000100:00100000:0.0:1789672909.637152:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789672909.637156:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738447232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672909.637164:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672909.637186:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738447232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672909.637190:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789672909.637209:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738447232:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789672910.022717:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672910.282383:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672910.282542:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714230016 00000100:00100000:1.0:1789672910.282553:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714230016 00000100:00100000:1.0:1789672910.282646:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 40 00000100:00100000:1.0:1789672910.282701:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:11093:x1876607714230016:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672910.282727:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672910.282754:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965319 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24fe1 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.282834:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965320 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.282848:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.282862:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672910.282919:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789672910.282923:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789672910.282963:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965320 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.283007:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965319 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fe1 expref: 7 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.283025:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965320 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fe1 expref: 6 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.283034:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc61501600) 00010000:00010000:1.0:1789672910.283037:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672910.283041:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a1a00, rc 0) 00000100:00100000:1.0:1789672910.283110:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f60bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:11093:x1876607714230016:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 454us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672910.283118:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 40 00000100:00080000:2.0:1789672910.283223:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672910.291072:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672910.296288:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714230144 00000100:00100000:1.0:1789672910.296305:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714230144 00000100:00100000:1.0:1789672910.296463:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:1.0:1789672910.296475:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:11094:x1876607714230144:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672910.296509:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672910.296532:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965327 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24fe8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.296598:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996532e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.296948:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996532e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.296962:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996532e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.296994:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965335 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297002:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965335 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297009:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965335 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297084:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1e00/0x6c78c4f8c996533c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297093:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1e00/0x6c78c4f8c996533c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297100:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1e00/0x6c78c4f8c996533c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672910.297139:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789672910.297143:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789672910.297161:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1e00/0x6c78c4f8c996533c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297172:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996532e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297179:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996532e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297185:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996532e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297213:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a1000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672910.297218:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996532e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297226:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996532e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297237:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc61501600) 00010000:00010000:1.0:1789672910.297240:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672910.297244:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996532e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297250:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996532e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297264:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965335 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297269:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965335 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297275:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965335 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297280:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672910.297283:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965335 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297289:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965335 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297306:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cfc61501000) 00010000:00010000:1.0:1789672910.297309:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672910.297312:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965335 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297318:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965335 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297350:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965327 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fe8 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297363:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1e00/0x6c78c4f8c996533c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fe8 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.297369:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cfc61501400) 00010000:00010000:1.0:1789672910.297372:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672910.297374:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a1e00, rc 0) 00000100:00100000:1.0:1789672910.297599:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:11094:x1876607714230144:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 1125us (6801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672910.297612:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:0.0:1789672910.304564:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672910.305436:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714230272 00000100:00100000:2.0:1789672910.305448:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714230272 00000100:00100000:2.0:1789672910.305613:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:2.0:1789672910.305627:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:11094:x1876607714230272:12345-192.168.201.50@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789672910.305749:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:11094:x1876607714230272:12345-192.168.201.50@tcp:900:lhsmtool_posix.0 Request processed in 125us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672910.305757:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:3.0:1789672910.310943:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672910.311050:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714230528 00000100:00100000:1.0:1789672910.311064:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714230528 00000100:00100000:1.0:1789672910.311178:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:1.0:1789672910.311189:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:11094:x1876607714230528:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672910.311212:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672910.311233:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965343 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24fef expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311335:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c996534a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311350:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c996534a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311361:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c996534a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311422:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965351 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311431:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965351 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311437:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965351 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311546:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0400/0x6c78c4f8c9965358 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311555:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0400/0x6c78c4f8c9965358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311562:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0400/0x6c78c4f8c9965358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672910.311572:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789672910.311713:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c996534a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311721:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c996534a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311736:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c996534a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311742:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672910.311747:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c996534a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311754:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c996534a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311767:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cfc61501400) 00010000:00010000:1.0:1789672910.311771:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672910.311775:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c996534a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311782:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c996534a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311796:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965351 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311802:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965351 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311808:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965351 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311813:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a1000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672910.311816:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965351 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311831:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965351 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311840:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cfc61501000) 00010000:00010000:1.0:1789672910.311843:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672910.311846:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965351 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.311853:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965351 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.312133:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965343 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fef expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.312148:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0400/0x6c78c4f8c9965358 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fef expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672910.312156:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfc61501100) 00010000:00010000:1.0:1789672910.312158:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672910.312160:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a0400, rc 0) 00000100:00100000:1.0:1789672910.312220:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:11094:x1876607714230528:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 1033us (1288us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789672910.312228:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:3.0:1789672910.326952:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672910.327090:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714230656 00000100:00100000:1.0:1789672910.327101:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714230656 00000100:00100000:1.0:1789672910.327166:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:1.0:1789672910.327177:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:11094:x1876607714230656:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789672910.327307:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:11094:x1876607714230656:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 Request processed in 131us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672910.327315:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:0.0:1789672910.334787:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672910.337311:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714230784 00000100:00100000:1.0:1789672910.337329:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714230784 00000100:00100000:1.0:1789672910.337416:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:1.0:1789672910.337427:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:11094:x1876607714230784:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1789672910.337636:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1789672910.343979:0:6512:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6485us 00000100:00100000:2.0:1789672910.354440:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:11094:x1876607714230784:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 Request processed in 17005us (19651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672910.354456:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 44 00000040:00080000:0.0:1789672910.596934:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789672910.661966:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672910.662002:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738447360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789672910.662076:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672910.662160:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738447360 00000100:00100000:2.0:1789672910.662181:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738447360 00000100:00100000:2.0:1789672910.662231:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789672910.662241:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738447360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789672910.662277:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789672910.662321:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738447360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672910.662328:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000040:00080000:3.0:1789672910.662350:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789672910.662374:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738447360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789672910.800344:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672910.800399:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672910.800432:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672910.800469:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672910.800502:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672910.800532:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714231040 00000100:00100000:3.0:1789672910.800542:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714231040 00000100:00100000:1.0:1789672910.800557:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714231296 00000100:00100000:1.0:1789672910.800565:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714231296 00000100:00100000:3.0:1789672910.800600:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714231168 00000100:00100000:3.0:1789672910.800604:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714231168 00000100:00100000:1.0:1789672910.800609:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714231424 00000100:00100000:1.0:1789672910.800615:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714231424 00000100:00100000:3.0:1789672910.800635:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 292 00000100:00100000:3.0:1789672910.800648:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2397:x1876607714231040:12345-192.168.201.50@tcp:400:kworker.0 00000100:00080000:0.0:1789672910.800705:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789672910.800711:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672910.800768:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2397:x1876607714231040:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 123us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672910.803716:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714230912 00000100:00100000:1.0:1789672910.803729:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714230912 00000100:00100000:1.0:1789672910.803785:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 384 00000100:00100000:1.0:1789672910.803796:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714230912:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672910.803882:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714230912:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 79us (3439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672910.803890:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 384 00000100:00100000:0.0:1789672910.806633:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 293 00000100:00100000:0.0:1789672910.806683:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714231296:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672910.806688:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 292 00000100:00100000:3.0:1789672910.806732:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 294 00000100:00100000:3.0:1789672910.806742:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714231168:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672910.806774:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714231296:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 118us (6373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672910.806783:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714231168:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 42us (6324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672910.806785:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 293 00000100:00100000:3.0:1789672910.806797:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 294 00000100:00100000:0.0:1789672910.806968:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 295 00000100:00100000:0.0:1789672910.806979:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714231424:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672910.807037:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714231424:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 59us (6534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672910.807045:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 295 00010000:00010000:2.0:1789672911.052002:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672911.684386:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738447488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789672911.684469:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672911.684548:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738447488 00000100:00100000:0.0:1789672911.684557:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738447488 00000100:00100000:0.0:1789672911.684607:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789672911.684617:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738447488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789672911.684654:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789672911.684722:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738447488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672911.684729:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789672911.684798:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f623100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738447488:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789672912.071378:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672912.636610:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672912.636788:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714231552 00000100:00100000:1.0:1789672912.636798:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714231552 00000100:00080000:0.0:1789672912.636885:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672912.636922:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 45 00000100:00100000:1.0:1789672912.636934:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:11138:x1876607714231552:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789672912.636956:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672912.636976:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965366 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24ff6 expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637270:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c996536d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637285:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c996536d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637299:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c996536d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637314:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965374 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637322:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965374 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637329:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965374 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637366:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c996536d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637373:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c996536d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637379:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c996536d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637385:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672912.637389:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c996536d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637405:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c996536d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637416:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc61501600) 00010000:00010000:1.0:1789672912.637418:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672912.637423:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c996536d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637428:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c996536d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637439:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965374 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637444:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965374 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637449:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965374 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637454:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672912.637457:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965374 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637463:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965374 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637470:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cfc61501800) 00010000:00010000:1.0:1789672912.637472:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672912.637475:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965374 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637490:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965374 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637524:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965366 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ff6 expref: 10 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637535:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc61501600) 00010000:00010000:1.0:1789672912.637537:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672912.637541:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965366 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ff6 expref: 10 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.637549:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a1000, rc 0) 00000100:00100000:1.0:1789672912.637769:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:11138:x1876607714231552:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 837us (1167us total) trans 0 rc 301/301 00000100:00100000:1.0:1789672912.637777:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 45 00000100:00100000:0.0:1789672912.642595:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672912.642902:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714231808 00000100:00100000:2.0:1789672912.642913:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714231808 00000100:00100000:2.0:1789672912.642989:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00100000:2.0:1789672912.643000:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:11138:x1876607714231808:12345-192.168.201.50@tcp:36:lfs.0 00010000:00010000:0.0:1789672912.643649:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672912.650113:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965320 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fe1 expref: 9 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.650137:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc61501600) 00010000:00010000:0.0:1789672912.650150:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672912.650536:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c996537b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.650550:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c996537b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.650568:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c996537b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.650582:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c9965382 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.650589:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c9965382 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.650595:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c9965382 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.651137:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965389 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.651148:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.651155:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789672912.651388:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c95cb5e1 reply state 00000000ea7bb5ae transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965389 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.651401:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965389 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.651408:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:0.0:1789672912.651410:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789672912.651479:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789672912.651486:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789672912.651494:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c996537b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.651509:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c996537b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.651516:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c996537b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.651522:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672912.651526:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c996537b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.651534:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c996537b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.651544:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfb46b95c00) 00010000:00010000:0.0:1789672912.651546:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672912.651550:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c996537b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.651555:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c996537b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789672912.651569:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c95cb5e1 reply state 00000000ea7bb5ae transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c9965382 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.651577:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c9965382 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.651583:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cfb46b95b00) 00010000:00010000:0.0:1789672912.651585:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789672912.651588:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789672912.651866:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+10:11138:x1876607714231808:12345-192.168.201.50@tcp:36:lfs.0 Request processed in 8864us (9274us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789672912.651880:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00100000:3.0:1789672912.754522:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672912.754622:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714231936 00000100:00100000:0.0:1789672912.754632:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714231936 00000100:00100000:0.0:1789672912.754732:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:0.0:1789672912.754743:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+10:11146:x1876607714231936:12345-192.168.201.50@tcp:101:lctl.0 00010000:00010000:0.0:1789672912.754768:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672912.755090:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965390 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd24ffd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.755155:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9965397 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.755169:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9965397 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.755181:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9965397 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672912.755227:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789672912.755232:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789672912.755272:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9965397 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.755374:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965390 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ffd expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.755392:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9965397 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ffd expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.755401:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfb46b95c00) 00010000:00010000:2.0:1789672912.755404:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789672912.755407:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef600, rc 0) 00000100:00100000:2.0:1789672912.755469:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+11:11146:x1876607714231936:12345-192.168.201.50@tcp:101:lctl.0 Request processed in 727us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672912.755475:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:3.0:1789672912.861078:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672912.861198:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714232064 00000100:00100000:1.0:1789672912.861207:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714232064 00000100:00100000:1.0:1789672912.861266:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:1.0:1789672912.861278:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+11:11152:x1876607714232064:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789672912.861298:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672912.861319:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996539e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25004 expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861383:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99653a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861397:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99653a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861421:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99653a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861431:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99653ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861438:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99653ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861444:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99653ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861519:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0e00/0x6c78c4f8c99653b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861528:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0e00/0x6c78c4f8c99653b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861535:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0e00/0x6c78c4f8c99653b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672912.861568:0:11081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789672912.861571:0:11081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789672912.861611:0:11081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0e00/0x6c78c4f8c99653b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861623:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99653a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861630:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99653a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861645:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99653a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861651:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672912.861655:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99653a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861697:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99653a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861709:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfb46b95c00) 00010000:00010000:1.0:1789672912.861712:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672912.861717:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99653a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861723:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99653a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861735:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99653ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861739:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99653ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861745:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99653ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861750:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672912.861753:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99653ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861768:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99653ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861776:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cfb46b95b00) 00010000:00010000:1.0:1789672912.861779:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672912.861782:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99653ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861788:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99653ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861813:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996539e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25004 expref: 13 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861827:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0e00/0x6c78c4f8c99653b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25004 expref: 12 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.861834:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:1.0:1789672912.861850:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789672912.861852:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a0e00, rc 0) 00000100:00100000:1.0:1789672912.861923:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+12:11152:x1876607714232064:12345-192.168.201.50@tcp:101:bash.0 Request processed in 647us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672912.861930:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:0.0:1789672912.866360:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672912.866532:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714232320 00000100:00100000:2.0:1789672912.866543:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714232320 00000100:00100000:2.0:1789672912.866601:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:2.0:1789672912.866612:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+12:11152:x1876607714232320:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789672912.866634:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672912.866692:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99653ba lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2500b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.866807:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99653c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.866821:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99653c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.866832:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99653c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.866879:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99653c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.866887:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99653c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.866895:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99653c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789672912.867362:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789672912.867497:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99653cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.867507:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99653cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.867515:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99653cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.867543:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99653c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.867550:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99653c1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.867558:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99653c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.867564:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aef800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672912.867568:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99653c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.867586:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99653c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.867598:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:2.0:1789672912.867601:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672912.867607:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99653c1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.867614:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99653c1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789672912.867627:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031866613 reply state 000000001fe31aa9 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99653c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.867638:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99653c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.867644:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfc4991c800) 00010000:00010000:2.0:1789672912.867647:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789672912.867649:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789672912.867714:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99653ba lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2500b expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.867741:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99653cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2500b expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.867749:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991cd00) 00010000:00010000:2.0:1789672912.867751:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672912.867753:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aeec00, rc 0) 00000100:00100000:2.0:1789672912.867820:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+15:11152:x1876607714232320:12345-192.168.201.50@tcp:101:bash.0 Request processed in 1209us (1470us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789672912.867833:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:2.0:1789672912.873414:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672912.873516:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714232448 00000100:00100000:0.0:1789672912.873525:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714232448 00000100:00100000:0.0:1789672912.873572:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:0.0:1789672912.873581:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2394:x1876607714232448:12345-192.168.201.50@tcp:8:bash.0 00010000:00080000:0.0:1789672912.873615:0:8430:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:0.0:1789672912.873645:0:8430:0:(genops.c:1384:class_connect()) connect: client ad795a16-0aa4-4e04-82a0-6f12aab5f2ea, cookie 0x6c78c4f8c99653dd 00002000:00100000:0.0:1789672912.873713:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ad795a16-0aa4-4e04-82a0-6f12aab5f2ea/ffff8cfb46bf5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789672912.873731:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789672912.873816:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789672912.873859:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8cfb47a6d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789672912.873923:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2394:x1876607714232448:12345-192.168.201.50@tcp:8:bash.0 Request processed in 341us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672912.873941:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:3.0:1789672912.877041:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672912.877173:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714232576 00000100:00100000:1.0:1789672912.877182:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714232576 00000100:00100000:1.0:1789672912.877260:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:1.0:1789672912.877270:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:0:x1876607714232576:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789672912.877305:0:8494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672912.877327:0:8494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038e10c5d/0x6c78c4f8c99653e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25012 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789672912.877354:0:8494:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789672912.877373:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1789672912.877378:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672912.877387:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038e10c5d/0x6c78c4f8c99653e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25012 expref: 7 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.877407:0:8494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038e10c5d/0x6c78c4f8c99653e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25012 expref: 7 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672912.877420:0:8494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a1000, rc 0) 00000100:00100000:1.0:1789672912.877478:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:0:x1876607714232576:12345-192.168.201.50@tcp:101:bash.0 Request processed in 210us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672912.877485:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00080000:0.0:1789672912.877759:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789672912.881276:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672912.881372:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714232704 00000100:00100000:0.0:1789672912.881382:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714232704 00000100:00100000:0.0:1789672912.881436:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:0.0:1789672912.881447:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:11152:x1876607714232704:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789672912.881477:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672912.881498:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25019 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.881527:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038e10c5d/0x6c78c4f8c99653e4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25012 expref: 8 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.881536:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672912.881540:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672912.881545:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25019 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.881578:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038e10c5d/0x6c78c4f8c99653e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25012 expref: 8 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.881592:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038e10c5d/0x6c78c4f8c99653e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25012 expref: 8 pid: 8494 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672912.881607:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f621500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1876607738447616:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789672912.881740:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4b95d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789672912.885575:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672912.885703:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714232832 00000100:00100000:2.0:1789672912.885712:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714232832 00010000:00010000:2.0:1789672912.885751:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038e10c5d/0x6c78c4f8c99653e4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25012 expref: 9 pid: 8494 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672912.885787:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:2.0:1789672912.885812:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc65c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2395:x1876607714232832:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672912.885826:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672912.885857:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038e10c5d/0x6c78c4f8c99653e4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25012 expref: 9 pid: 8494 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.885872:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038e10c5d/0x6c78c4f8c99653e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25012 expref: 9 pid: 8494 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.885898:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672912.885903:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672912.885912:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25019 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.885922:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25019 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672912.886134:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25019 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672912.886153:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd43b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1876607738447744:192.168.201.50@tcp:105: 00000100:00100000:2.0:1789672912.886241:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc593eab40 going to sleep for 11 seconds 00010000:00010000:0.0:1789672912.887012:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038e10c5d/0x6c78c4f8c99653e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25012 expref: 9 pid: 8494 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672912.887030:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f621500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1876607738447616:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789672912.887114:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25019 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672912.887136:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cda00, rc 0) 00000100:00100000:0.0:1789672912.887186:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:11152:x1876607714232704:12345-192.168.201.50@tcp:101:bash.0 Request processed in 5741us (5919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672912.887205:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:3.0:1789672912.893061:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672912.893240:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714233088 00000100:00100000:0.0:1789672912.893251:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714233088 00000100:00100000:0.0:1789672912.893313:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:0.0:1789672912.893325:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+15:11152:x1876607714233088:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:0.0:1789672912.893633:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+16:11152:x1876607714233088:12345-192.168.201.50@tcp:35:bash.0 Request processed in 310us (581us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789672912.893641:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:2.0:1789672912.896401:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd43b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1876607738447744:192.168.201.50@tcp:105: 00010000:00010000:2.0:1789672912.896430:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672912.896497:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc65c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2395:x1876607714232832:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 10701us (10930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672912.896507:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:3.0:1789672913.010255:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672913.010441:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714233344 00000100:00100000:2.0:1789672913.010451:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714233344 00000100:00100000:2.0:1789672913.010510:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:2.0:1789672913.010520:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+16:11162:x1876607714233344:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789672913.010546:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672913.010565:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99653f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25020 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672913.010701:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789672913.010802:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99653f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25020 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.010816:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfb46b95c00) 00010000:00010000:2.0:1789672913.010819:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789672913.010847:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99653f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25020 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.010861:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee600, rc 0) 00000100:00100000:2.0:1789672913.013368:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+17:11162:x1876607714233344:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 2837us (3121us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1789672913.013381:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:3.0:1789672913.024268:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672913.024559:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714233600 00000100:00100000:0.0:1789672913.024569:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714233600 00000100:00100000:0.0:1789672913.024634:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:0.0:1789672913.024645:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+17:11162:x1876607714233600:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:0.0:1789672913.024923:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+18:11162:x1876607714233600:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 279us (663us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789672913.024931:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00010000:00010000:3.0:1789672913.092910:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672913.110485:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672913.110651:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714233728 00000100:00100000:2.0:1789672913.110706:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714233728 00000100:00100000:2.0:1789672913.110771:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:2.0:1789672913.110782:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+18:11168:x1876607714233728:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789672913.110808:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672913.110828:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c9965400 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25027 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.110947:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.110962:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.110985:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672913.111037:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789672913.111041:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789672913.111387:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.111418:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c9965400 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25027 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.111444:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965407 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25027 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.111452:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:2.0:1789672913.111456:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789672913.111459:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef800, rc 0) 00000100:00100000:2.0:1789672913.111523:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:11168:x1876607714233728:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 743us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672913.111531:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:3.0:1789672913.117713:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672913.117923:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714233984 00000100:00100000:2.0:1789672913.117933:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714233984 00000100:00100000:2.0:1789672913.118004:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:2.0:1789672913.118015:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:11168:x1876607714233984:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789672913.118036:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672913.118066:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c996540e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2502e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.118171:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965415 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.118185:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.118208:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672913.118219:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789672913.118343:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c996540e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2502e expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.118362:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965415 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2502e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.118371:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991cd00) 00010000:00010000:2.0:1789672913.118374:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672913.118378:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef400, rc 0) 00000100:00100000:2.0:1789672913.118444:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:11168:x1876607714233984:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 431us (740us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789672913.118451:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:3.0:1789672913.122141:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672913.122283:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714234112 00000100:00100000:2.0:1789672913.122294:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714234112 00000100:00100000:2.0:1789672913.122366:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:2.0:1789672913.122376:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:2396:x1876607714234112:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672913.122391:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672913.122415:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965415 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2502e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.122433:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991cd00) 00010000:00010000:2.0:1789672913.122438:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672913.122501:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:2396:x1876607714234112:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 124us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672913.122510:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:3.0:1789672913.124250:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672913.124324:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714234368 00000100:00100000:2.0:1789672913.124333:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714234368 00000100:00100000:2.0:1789672913.124397:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:2.0:1789672913.124408:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:11168:x1876607714234368:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789672913.124431:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672913.124450:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c9965423 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25035 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.124555:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c996542a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.124571:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c996542a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.124582:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c996542a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672913.124595:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789672913.124728:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c9965423 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25035 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.124745:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c996542a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25035 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.124754:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991cd00) 00010000:00010000:2.0:1789672913.124756:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789672913.124760:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aeea00, rc 0) 00000100:00100000:2.0:1789672913.124822:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:11168:x1876607714234368:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 416us (578us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789672913.124829:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:3.0:1789672913.134060:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672913.134186:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714234496 00000100:00100000:1.0:1789672913.134209:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714234496 00000100:00100000:1.0:1789672913.134280:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:1.0:1789672913.134291:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2397:x1876607714234496:12345-192.168.201.50@tcp:1:lfs.0 00010000:00010000:1.0:1789672913.134342:0:8494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965438 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.134363:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25019 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.134393:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789672913.134398:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789672913.134403:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965438 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.134440:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25019 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.134453:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25019 expref: 7 pid: 8430 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672913.134468:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47984000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8494:1876607738447872:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672913.134564:0:8494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467fbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789672913.139217:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47984000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8494:1876607738447872:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672913.139245:0:8494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965438 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672913.139311:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672913.139403:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714234624 00000100:00100000:3.0:1789672913.139410:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714234624 00002000:00100000:3.0:1789672913.139457:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8cfc7f621500 x1876607714234624/t0(0) o4->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:539/0 lens 504/0 e 0 to 0 dl 1789672924 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789672913.139480:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfc7f621500 with x1876607714234624 ext(0->12) 00010000:00010000:3.0:1789672913.139488:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25019 expref: 8 pid: 8430 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.139503:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25019 expref: 8 pid: 8430 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789672913.139511:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cfc7f621500 00000100:00100000:3.0:1789672913.139550:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:3.0:1789672913.139560:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2396:x1876607714234624:12345-192.168.201.50@tcp:4:lfs.0 00000001:00100000:1.0:1789672913.141927:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000100:00100000:3.0:1789672913.142642:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f621500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2396:x1876607714234624:12345-192.168.201.50@tcp:4:lfs.0 Request processed in 3076us (3324us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789672913.142673:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00002000:00100000:3.0:1789672913.142686:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8cfc7f621500 x1876607714234624/t4294967300(0) o4->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:539/0 lens 504/448 e 0 to 0 dl 1789672924 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789672913.142697:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfc7f621500 with x1876607714234624 ext(0->12) 00010000:00010000:3.0:1789672913.142707:0:8433:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25019 expref: 9 pid: 8430 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.142724:0:8433:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25019 expref: 9 pid: 8430 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789672913.142732:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cfc7f621500 00000100:00100000:3.0:1789672913.145405:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672913.145532:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714234752 00000100:00100000:1.0:1789672913.145543:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714234752 00010000:00010000:1.0:1789672913.145581:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25019 expref: 9 pid: 8430 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672913.145896:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:1.0:1789672913.145914:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2395:x1876607714234752:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672913.146053:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789672913.146072:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789672913.146075:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789672911 00002000:00010000:1.0:1789672913.146077:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789672911 00002000:00010000:1.0:1789672913.146079:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789672911 00002000:00010000:1.0:1789672913.146082:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789672913.146089:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25019 expref: 9 pid: 8430 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.146104:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25019 expref: 9 pid: 8430 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.146128:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a24e6ee3/0x6c78c4f8c99653eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25019 expref: 9 pid: 8430 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.146146:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789672913.146150:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789672913.146156:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965438 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.146167:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965438 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.146249:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672913.146314:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2395:x1876607714234752:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 402us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672913.146397:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 53 00010000:00010000:3.0:1789672913.147602:0:8494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965438 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.147618:0:8494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965438 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.147646:0:8494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965438 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.147654:0:8494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965438 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.147676:0:8494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965438 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.147758:0:8494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0a00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789672913.147764:0:8494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965438 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.147774:0:8494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965438 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.147805:0:8494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965438 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.147814:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965438 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672913.148139:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2397:x1876607714234496:12345-192.168.201.50@tcp:1:lfs.0 Request processed in 13847us (14098us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672913.148149:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:3.0:1789672913.154268:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672913.154467:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714235008 00000100:00100000:2.0:1789672913.154489:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714235008 00000100:00100000:2.0:1789672913.154547:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:2.0:1789672913.154558:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:11168:x1876607714235008:12345-192.168.201.50@tcp:35:lfs.0 00000004:00010000:2.0:1789672913.154623:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c996542a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25035 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789672913.154886:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1789672913.154954:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789672913.155546:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1789672913.155582:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996543f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.155598:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99653cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2500b expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.155606:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996543f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.155640:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99653cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2500b expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.156132:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99653cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2500b expref: 26 pid: 6514 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672913.156153:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd43b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1876607738448000:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789672913.156255:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789672913.160445:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd43b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1876607738448000:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789672913.160476:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996543f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672913.161513:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672913.162495:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714235136 00000100:00100000:2.0:1789672913.162510:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714235136 00010000:00010000:2.0:1789672913.162553:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99653cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2500b expref: 27 pid: 6514 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672913.162616:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:2.0:1789672913.162626:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c404700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+27:2395:x1876607714235136:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672913.162642:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672913.162649:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99653cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2500b expref: 27 pid: 6514 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.162772:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99653cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2500b expref: 27 pid: 6514 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.162897:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99653cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2500b expref: 27 pid: 6514 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.162917:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991cd00) 00010000:00010000:2.0:1789672913.162922:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996543f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.162933:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996543f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.163112:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996543f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.163199:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672913.163259:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c404700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+26:2395:x1876607714235136:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 635us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672913.163267:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 54 00010000:00010000:1.0:1789672913.165407:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996543f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.165424:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996543f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789672913.165645:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1789672913.166158:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1789672913.166418:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd43100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1876607738448128:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789672913.166487:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672913.167215:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672913.167484:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738448128 00000100:00100000:0.0:1789672913.167493:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738448128 00000100:00100000:0.0:1789672913.167605:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789672913.167617:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1876607738448128:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789672913.167790:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1876607738448128:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 177us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672913.167812:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789672913.168000:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd43100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1876607738448128:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789672913.168179:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1789672913.168292:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc477d8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1876607738448256:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789672913.168698:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672913.168723:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4689e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789672913.169143:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738448256 00000100:00100000:1.0:1789672913.169153:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738448256 00000100:00100000:1.0:1789672913.169213:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789672913.169224:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1876607738448256:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789672913.169397:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6515:x1876607738448256:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 175us (699us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789672913.169405:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789672913.169728:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc477d8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1876607738448256:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789672913.169797:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1789672913.169847:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996543f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.170154:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996543f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.170164:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996543f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.170170:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aeee00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672913.170184:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996543f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.170192:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996543f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.170206:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991cd00) 00010000:00010000:3.0:1789672913.170209:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789672913.170213:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996543f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.170220:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c996543f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789672913.170398:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789672913.170460:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1789672913.170472:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391085812072ns, next at 392085809450ns, rc = 0 00000001:00080000:3.0:1789672913.170478:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1789672913.170502:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991cd00) 00010000:00010000:3.0:1789672913.170505:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789672913.170512:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c996542a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25035 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672913.170626:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+29:11168:x1876607714235008:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 16070us (16367us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1789672913.170635:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 8 00000020:00080000:3.0:1789672913.170639:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1789672913.173516:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672913.176433:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672913.176569:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714235264 00000100:00100000:2.0:1789672913.176580:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714235264 00000100:00100000:2.0:1789672913.176814:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:2.0:1789672913.176837:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+29:11168:x1876607714235264:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789672913.177059:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672913.177085:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965446 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2503c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.177145:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965446 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2503c expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.177160:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965446 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2503c expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672913.177177:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:2.0:1789672913.177180:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789672913.177184:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aefc00, rc 0) 00000100:00100000:2.0:1789672913.177255:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+30:11168:x1876607714235264:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 431us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672913.181719:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672913.181809:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714235520 00000100:00100000:3.0:1789672913.181820:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714235520 00000100:00100000:3.0:1789672913.181910:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:3.0:1789672913.181920:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f855050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+31:11168:x1876607714235520:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789672913.182386:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f855050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+32:11168:x1876607714235520:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 466us (675us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789672913.182394:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:2.0:1789672913.183101:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:0.0:1789672913.220015:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738448384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789672913.220102:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672913.220157:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738448512:0@lo:400:kworker.0 00000100:00100000:0.0:1789672913.220171:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738448896:0@lo:400:kworker.0 00000100:00100000:1.0:1789672913.220241:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738448640:0@lo:400:kworker.0 00000100:00100000:2.0:1789672913.223351:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738448384 00000100:00100000:2.0:1789672913.223367:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738448384 00000100:00100000:2.0:1789672913.223443:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789672913.223470:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738448384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789672913.223498:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672913.227468:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672913.227560:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738449408:0@lo:400:kworker.0 00000100:00100000:0.0:1789672913.227608:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672913.227642:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738449408 00000100:00100000:0.0:1789672913.227650:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738449408 00000100:00100000:3.0:1789672913.228349:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672913.228402:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738448512 00000100:00100000:3.0:1789672913.228408:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738448512 00000100:00100000:3.0:1789672913.228460:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789672913.228470:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3636:x1876607738448512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672913.228528:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3636:x1876607738448512:12345-0@lo:400:kworker.0 Request processed in 60us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672913.228534:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789672913.228783:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738448896 00000100:00100000:1.0:1789672913.228788:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738448896 00000100:00100000:1.0:1789672913.228822:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789672913.228840:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738448896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672913.228884:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738448896:12345-0@lo:400:kworker.0 Request processed in 55us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672913.228890:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789672913.228918:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738448768:0@lo:400:kworker.0 00000100:00100000:1.0:1789672913.229178:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672913.229218:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738449280:0@lo:400:kworker.0 00000100:00100000:1.0:1789672913.229259:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672913.229281:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876607738449792:0@lo:400:kworker.0 00000100:00100000:1.0:1789672913.229303:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672913.229353:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672913.229375:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738449280 00000100:00100000:1.0:1789672913.229379:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738449280 00000100:00100000:1.0:1789672913.229407:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738449792 00000100:00100000:1.0:1789672913.229410:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738449792 00000100:00100000:1.0:1789672913.229427:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738448640 00000100:00100000:1.0:1789672913.229429:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738448640 00000100:00100000:1.0:1789672913.229443:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789672913.229450:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738449280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672913.229486:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738449280:12345-0@lo:400:kworker.0 Request processed in 37us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672913.229493:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789672913.229507:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789672913.229513:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876607738449792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672913.229539:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876607738449792:12345-0@lo:400:kworker.0 Request processed in 26us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672913.229544:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789672913.229554:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789672913.229559:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738448640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672913.229580:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738448640:12345-0@lo:400:kworker.0 Request processed in 22us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672913.229586:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00010000:00080000:1.0:1789672913.229620:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47986300 x1876607738449280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672913.229646:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738449280:0@lo:400:kworker.0 00010000:00080000:1.0:1789672913.229687:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47985c00 x1876607738449792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672913.229697:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876607738449792:0@lo:400:kworker.0 00000100:00100000:1.0:1789672913.229731:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738448640:0@lo:400:kworker.0 00000100:00100000:0.0:1789672913.229828:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789672913.229845:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738448768 00000100:00100000:3.0:1789672913.229849:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738448768 00000100:00100000:0.0:1789672913.229849:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738449408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672913.229878:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789672913.229884:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738448768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672913.229887:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738449408:12345-0@lo:400:kworker.0 Request processed in 43us (2279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672913.229893:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789672913.229927:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738448768:12345-0@lo:400:kworker.0 Request processed in 43us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672913.229927:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738449408:0@lo:400:kworker.0 00000100:00100000:0.0:1789672913.229935:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738449920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672913.229960:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672913.229999:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738448896:0@lo:400:kworker.0 00000100:00100000:3.0:1789672913.230007:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789672913.230016:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672913.230021:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738449536:0@lo:400:kworker.0 00000100:00100000:3.0:1789672913.230034:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738449920 00000100:00100000:3.0:1789672913.230037:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738449920 00000100:00100000:0.0:1789672913.230044:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672913.230064:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738449536 00000100:00100000:0.0:1789672913.230069:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738449536 00000100:00100000:0.0:1789672913.230093:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789672913.230106:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738449536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672913.230135:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789672913.230135:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738449536:12345-0@lo:400:kworker.0 Request processed in 30us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672913.230141:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789672913.230142:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1876607738449920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789672913.230158:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672913.230163:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738449536:0@lo:400:kworker.0 00000100:00100000:1.0:1789672913.230215:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738449152:0@lo:400:kworker.0 00000100:00100000:1.0:1789672913.230238:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672913.230256:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738449152 00000100:00100000:1.0:1789672913.230260:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738449152 00000100:00100000:1.0:1789672913.230283:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789672913.230289:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738449152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672913.230315:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738449152:12345-0@lo:400:kworker.0 Request processed in 27us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672913.230320:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789672913.230348:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738449152:0@lo:400:kworker.0 00000100:00100000:1.0:1789672913.230355:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738449664:0@lo:400:kworker.0 00000100:00100000:1.0:1789672913.230376:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672913.230391:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738448768:0@lo:400:kworker.0 00000100:00080000:0.0:1789672913.230438:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789672913.230443:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789672913.230446:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789672913.230447:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789672913.230845:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738448512:0@lo:400:kworker.0 00000100:00100000:0.0:1789672913.230854:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738449024:0@lo:400:kworker.0 00000100:00100000:0.0:1789672913.230884:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672913.235289:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738449024 00000100:00100000:1.0:1789672913.235305:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738449024 00000100:00100000:1.0:1789672913.235376:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789672913.235386:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738449024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672913.235487:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738449024:12345-0@lo:400:kworker.0 Request processed in 103us (4602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672913.235509:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789672913.235561:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738449024:0@lo:400:kworker.0 00000100:00100000:3.0:1789672913.238468:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1876607738449920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8316us (8497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672913.238482:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789672913.238541:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738449664 00000100:00100000:3.0:1789672913.238553:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738449664 00000100:00100000:3.0:1789672913.238628:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789672913.238636:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738449664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672913.238720:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738449664:12345-0@lo:400:kworker.0 Request processed in 84us (8343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672913.238727:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:1.0:1789672913.238921:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672913.238966:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738449664:0@lo:400:kworker.0 00000100:00100000:2.0:1789672913.242329:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f623800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738448384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 18851us (22216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672913.242345:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789672913.246583:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738449920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672913.246620:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738448384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789672913.399747:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672913.403727:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714235776 00000100:00100000:1.0:1789672913.403746:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714235776 00000100:00100000:1.0:1789672913.404250:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:1.0:1789672913.404264:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+31:11178:x1876607714235776:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789672913.404291:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672913.404313:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c996544d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25043 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672913.404489:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789672913.404598:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c996544d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25043 expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.404614:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfb46b95c00) 00010000:00010000:1.0:1789672913.404617:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672913.404623:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c996544d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25043 expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.404637:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a0000, rc 0) 00000100:00100000:1.0:1789672913.404819:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+32:11178:x1876607714235776:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 550us (5083us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1789672913.404836:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:1.0:1789672913.412973:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672913.413153:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714235904 00000100:00100000:3.0:1789672913.413165:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714235904 00000100:00100000:3.0:1789672913.413232:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:3.0:1789672913.413243:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+32:11178:x1876607714235904:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:3.0:1789672913.413460:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996545b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.413479:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996545b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.413491:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996545b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.413501:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965462 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.413508:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.413525:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.413619:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965469 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.413627:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.413633:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672913.413740:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.413756:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996545b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.413762:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996545b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.413770:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996545b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.413776:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672913.413780:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996545b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.413788:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996545b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.413801:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:3.0:1789672913.413975:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672913.413982:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996545b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.413988:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996545b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.414002:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.414007:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965462 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.414013:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965462 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.414018:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672913.414021:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965462 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.414026:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965462 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.414034:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfc4991c800) 00010000:00010000:3.0:1789672913.414036:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672913.414039:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965462 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.414154:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965462 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.414166:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.414179:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965469 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.414184:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965469 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.414190:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672913.414193:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965469 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.414200:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965469 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.414208:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:3.0:1789672913.414211:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672913.414214:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965469 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.414219:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965469 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672913.414432:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+32:11178:x1876607714235904:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 1187us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672913.414442:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:0.0:1789672913.433614:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672913.433698:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714236160 00000100:00100000:1.0:1789672913.433710:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714236160 00000100:00100000:1.0:1789672913.433853:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:1.0:1789672913.433867:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+32:11178:x1876607714236160:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:1.0:1789672913.435252:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+33:11178:x1876607714236160:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 1383us (1642us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1789672913.435264:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:2.0:1789672913.513848:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672913.514067:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714236416 00000100:00100000:3.0:1789672913.514078:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714236416 00000100:00100000:3.0:1789672913.514177:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:3.0:1789672913.514189:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+33:11181:x1876607714236416:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789672913.514213:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672913.514246:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965470 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2504a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514331:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965477 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514348:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965477 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514361:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965477 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514372:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996547e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514379:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996547e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514385:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996547e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514493:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965485 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514502:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514508:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672913.514519:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789672913.514594:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965477 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514611:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965477 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514617:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965477 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514622:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672913.514626:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965477 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514632:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965477 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514643:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:3.0:1789672913.514646:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672913.514651:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965477 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514683:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965477 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514697:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996547e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514702:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996547e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514707:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996547e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514711:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672913.514720:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996547e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514726:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996547e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514733:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfc4991c800) 00010000:00010000:3.0:1789672913.514735:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672913.514739:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996547e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514745:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996547e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514791:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965470 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2504a expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514804:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2504a expref: 35 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.514988:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:3.0:1789672913.514990:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672913.514993:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887a00, rc 0) 00000100:00100000:3.0:1789672913.515061:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+35:11181:x1876607714236416:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 875us (1236us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789672913.515070:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:2.0:1789672913.520947:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672913.521145:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714236544 00000100:00100000:1.0:1789672913.521156:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714236544 00000100:00100000:1.0:1789672913.521255:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:1.0:1789672913.521266:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+35:11181:x1876607714236544:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:1.0:1789672913.521345:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965493 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.521362:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.521374:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.521409:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.521416:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965493 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.521424:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965493 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.521430:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672913.521447:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965493 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.521455:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965493 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.521468:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:1.0:1789672913.521470:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672913.521475:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965493 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.521481:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965493 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672913.521558:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+35:11181:x1876607714236544:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 293us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672913.521566:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:0.0:1789672913.526644:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672913.526880:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714236800 00000100:00100000:3.0:1789672913.526891:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714236800 00000100:00100000:3.0:1789672913.526946:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:3.0:1789672913.526956:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+35:11181:x1876607714236800:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789672913.527243:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+36:11181:x1876607714236800:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 287us (607us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789672913.527251:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 11 00000040:00080000:2.0:1789672913.672036:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789672913.854294:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672913.854396:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714237056 00000100:00100000:3.0:1789672913.854407:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714237056 00000100:00100000:3.0:1789672913.854506:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:3.0:1789672913.854581:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+36:11212:x1876607714237056:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:3.0:1789672913.854613:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672913.854637:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996549a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25051 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.854793:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c99654a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.854835:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c99654a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.854847:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c99654a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672913.854859:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789672913.855001:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996549a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25051 expref: 39 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.855022:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c99654a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25051 expref: 38 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.855031:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:3.0:1789672913.855047:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672913.855051:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887200, rc 0) 00000100:00100000:3.0:1789672913.855118:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+38:11212:x1876607714237056:12345-192.168.201.50@tcp:101:cat.0 Request processed in 604us (836us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789672913.855126:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:2.0:1789672913.863099:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672913.863148:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672913.863245:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714237440 00000100:00100000:0.0:1789672913.863255:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714237440 00000100:00100000:0.0:1789672913.863333:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:0.0:1789672913.863345:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+38:2398:x1876607714237440:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672913.863360:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672913.863400:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c99654a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25051 expref: 38 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672913.863439:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:0.0:1789672913.863444:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672913.863501:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+37:2398:x1876607714237440:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 158us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672913.863509:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:3.0:1789672913.864180:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714237312 00000100:00100000:3.0:1789672913.864188:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714237312 00000100:00100000:3.0:1789672913.864264:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:3.0:1789672913.864284:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+37:11212:x1876607714237312:12345-192.168.201.50@tcp:35:cat.0 00000100:00100000:3.0:1789672913.864695:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+38:11212:x1876607714237312:12345-192.168.201.50@tcp:35:cat.0 Request processed in 412us (1604us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1789672913.864704:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:2.0:1789672913.931427:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672913.931597:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714237696 00000100:00100000:3.0:1789672913.931607:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714237696 00000100:00100000:3.0:1789672913.931763:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:3.0:1789672913.931775:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+38:11218:x1876607714237696:12345-192.168.201.50@tcp:101:dd.0 00010000:00010000:3.0:1789672913.931799:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672913.931802:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789672913.931847:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965407 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25027 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.931865:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:3.0:1789672913.931870:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672913.931884:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c99654af lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25058 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.932006:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99654b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.932036:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965485 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2504a expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.932045:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99654b6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.932080:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2504a expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.932095:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965485 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2504a expref: 38 pid: 6514 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672913.932111:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc477daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738450048:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672913.932218:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4689e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789672913.938326:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc477daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738450048:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789672913.938352:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99654b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672913.938891:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672913.939371:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714237824 00000100:00100000:3.0:1789672913.939378:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714237824 00010000:00010000:3.0:1789672913.939410:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965485 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2504a expref: 39 pid: 6514 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672913.939471:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:3.0:1789672913.939478:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+39:2396:x1876607714237824:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672913.939490:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672913.939506:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965485 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2504a expref: 39 pid: 6514 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.939514:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2504a expref: 39 pid: 6514 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.939535:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965485 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2504a expref: 39 pid: 6514 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.939550:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:3.0:1789672913.939555:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99654b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.939565:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99654b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.939572:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99654b6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672913.939596:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672913.939632:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+38:2396:x1876607714237824:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 155us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672913.939638:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 55 00010000:00010000:0.0:1789672913.939741:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99654b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672913.939750:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99654b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672913.939768:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789672913.939934:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c99654af lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25058 expref: 39 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672913.939949:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99654b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25058 expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672913.939956:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:0.0:1789672913.939959:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789672913.939961:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886200, rc 0) 00000100:00100000:0.0:1789672913.940004:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+38:11218:x1876607714237696:12345-192.168.201.50@tcp:101:dd.0 Request processed in 8232us (8587us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789672913.940011:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:0.0:1789672913.941915:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672913.941972:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714237952 00000100:00100000:1.0:1789672913.941981:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714237952 00000100:00100000:1.0:1789672913.942025:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:1.0:1789672913.942032:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+38:11218:x1876607714237952:12345-192.168.201.50@tcp:101:dd.0 00010000:00010000:1.0:1789672913.942051:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672913.942164:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99654c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2505f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.942207:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99654cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.942228:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99654cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.942258:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99654cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.942347:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99654c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2505f expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.942359:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99654cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2505f expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672913.942365:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:1.0:1789672913.942367:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789672913.942370:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a0a00, rc 0) 00000100:00100000:1.0:1789672913.942410:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+39:11218:x1876607714237952:12345-192.168.201.50@tcp:101:dd.0 Request processed in 379us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672913.942415:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:2.0:1789672913.944729:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672913.944792:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714238208 00000100:00100000:0.0:1789672913.944803:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714238208 00000100:00100000:0.0:1789672913.944881:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:0.0:1789672913.944889:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+39:11218:x1876607714238208:12345-192.168.201.50@tcp:36:dd.0 00010000:00010000:0.0:1789672913.945097:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c99654d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672913.945109:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c99654d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672913.945117:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c99654d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672913.945150:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1789672913.945165:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa7fed76 reply state 000000008ca70acd transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c99654d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672913.945174:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c99654d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672913.945179:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:0.0:1789672913.945181:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789672913.945184:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789672913.945252:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+42:11218:x1876607714238208:12345-192.168.201.50@tcp:36:dd.0 Request processed in 365us (531us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1789672913.945257:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 62 00000020:00080000:0.0:1789672913.945261:0:9524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789672914.109730:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.109773:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714238336 00000100:00100000:0.0:1789672914.109783:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714238336 00000100:00080000:1.0:1789672914.109854:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672914.109872:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:0.0:1789672914.109885:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+42:11232:x1876607714238336:12345-192.168.201.50@tcp:101:stat.0 00010000:00010000:0.0:1789672914.109911:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672914.109947:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c99654d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25066 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.110014:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99654e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.110029:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99654e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.110042:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99654e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.110053:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99654e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.110061:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99654e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.110080:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99654e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.110156:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c99654ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.110167:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99654b6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25058 expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.110175:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c99654ee lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.110210:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99654b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25058 expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.110235:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99654b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25058 expref: 43 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672914.110248:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738450176:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789672914.110334:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc44cc1540 going to sleep for 11 seconds 00000100:00100000:0.0:1789672914.113254:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738450176:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789672914.113285:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c99654ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672914.113755:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.114091:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714238592 00000100:00100000:1.0:1789672914.114100:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714238592 00000100:00100000:1.0:1789672914.114152:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:1.0:1789672914.114163:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+44:6168:x1876607714238592:12345-192.168.201.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789672914.114602:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+45:6168:x1876607714238592:12345-192.168.201.50@tcp:35:ldlm_bl.0 Request processed in 435us (843us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789672914.114610:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00010000:00010000:2.0:1789672914.115982:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672914.116180:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.116296:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714238720 00000100:00100000:0.0:1789672914.116305:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714238720 00010000:00010000:0.0:1789672914.116340:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99654b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25058 expref: 45 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672914.116377:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:0.0:1789672914.116387:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+45:2396:x1876607714238720:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672914.116400:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672914.116407:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99654b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25058 expref: 45 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.116420:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99654b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25058 expref: 45 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.116440:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99654b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25058 expref: 45 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.116476:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:0.0:1789672914.116482:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c99654ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.116492:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c99654ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.116499:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c99654ee lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.116525:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672914.116561:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+44:2396:x1876607714238720:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 176us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672914.116568:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 56 00010000:00010000:3.0:1789672914.116697:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c99654ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.116706:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c99654ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672914.116751:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789672914.116756:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789672914.116835:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c99654ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.116849:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c99654ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.116858:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99654e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.116865:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99654e0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.116871:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99654e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.116876:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672914.116880:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99654e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.116888:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99654e0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.116896:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:3.0:1789672914.116899:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672914.116904:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99654e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.116915:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99654e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.116926:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99654e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.116932:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99654e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.116945:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99654e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.116950:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8ccc00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672914.116953:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99654e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.116959:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99654e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.116967:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfc4991c800) 00010000:00010000:3.0:1789672914.116970:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672914.116973:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99654e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.116979:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99654e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.117009:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c99654d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25066 expref: 44 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.117022:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c99654ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25066 expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.117028:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:3.0:1789672914.117030:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672914.117032:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cc800, rc 0) 00000100:00100000:3.0:1789672914.117081:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+43:11232:x1876607714238336:12345-192.168.201.50@tcp:101:stat.0 Request processed in 7200us (7358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672914.117095:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:2.0:1789672914.170214:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.170558:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714238976 00000100:00100000:1.0:1789672914.170569:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714238976 00000100:00100000:1.0:1789672914.170623:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:1.0:1789672914.170634:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+43:11238:x1876607714238976:12345-192.168.201.50@tcp:36:truncate.0 00010000:00010000:1.0:1789672914.170736:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672914.170771:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c99654ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25066 expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.170785:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:1.0:1789672914.170789:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672914.170961:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99654f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.170973:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99654f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.170980:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99654f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789672914.171012:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1789672914.171027:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006543b64d reply state 0000000054def0cc transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99654f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.171036:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99654f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.171040:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:1.0:1789672914.171042:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789672914.171043:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789672914.171174:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+45:11238:x1876607714238976:12345-192.168.201.50@tcp:36:truncate.0 Request processed in 542us (968us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789672914.171179:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 64 00000020:00080000:1.0:1789672914.171183:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789672914.263012:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.263122:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714239104 00000100:00100000:1.0:1789672914.263145:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714239104 00000100:00100000:1.0:1789672914.263240:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:1.0:1789672914.263253:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+45:11252:x1876607714239104:12345-192.168.201.50@tcp:101:stat.0 00010000:00010000:1.0:1789672914.263280:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672914.263303:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c99654fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2506d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.263375:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965503 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.263500:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965503 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.263515:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965503 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.263531:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c996550a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.263538:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c996550a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.263545:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c996550a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.263623:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc40031000/0x6c78c4f8c9965511 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.263633:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc40031000/0x6c78c4f8c9965511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.263640:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc40031000/0x6c78c4f8c9965511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672914.263918:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789672914.263924:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789672914.263947:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc40031000/0x6c78c4f8c9965511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.263961:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc40031000/0x6c78c4f8c9965511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.263969:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965503 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.263975:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965503 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.263982:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965503 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.263988:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a1a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672914.263993:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965503 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.264000:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965503 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.264013:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:1.0:1789672914.264016:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672914.264021:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965503 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.264027:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965503 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.264052:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c996550a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.264058:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c996550a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.264064:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c996550a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.264070:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61609c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672914.264073:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c996550a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.264078:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c996550a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.264086:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfc4991c800) 00010000:00010000:1.0:1789672914.264088:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672914.264092:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c996550a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.264097:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c996550a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.264128:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c99654fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2506d expref: 47 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.264142:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc40031000/0x6c78c4f8c9965511 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2506d expref: 46 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.264160:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:1.0:1789672914.264162:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672914.264165:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc40031000, rc 0) 00000100:00100000:1.0:1789672914.264245:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+46:11252:x1876607714239104:12345-192.168.201.50@tcp:101:stat.0 Request processed in 994us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672914.264253:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:2.0:1789672914.353718:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672914.353856:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714239360 00000100:00100000:3.0:1789672914.353867:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714239360 00000100:00100000:3.0:1789672914.353932:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:3.0:1789672914.353943:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+46:11262:x1876607714239360:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789672914.353964:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672914.353984:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965518 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25074 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672914.354329:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789672914.354427:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965518 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25074 expref: 48 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.354441:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfb46b95c00) 00010000:00010000:3.0:1789672914.354443:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789672914.354448:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965518 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25074 expref: 48 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.354463:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887a00, rc 0) 00000100:00100000:3.0:1789672914.354537:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+47:11262:x1876607714239360:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 595us (827us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1789672914.354545:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:2.0:1789672914.357264:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672914.357308:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714239616 00000100:00100000:3.0:1789672914.357318:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714239616 00000100:00100000:3.0:1789672914.357365:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:3.0:1789672914.357373:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+47:11262:x1876607714239616:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789672914.357573:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+48:11262:x1876607714239616:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 200us (315us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1789672914.357580:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:2.0:1789672914.406115:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.406173:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714239872 00000100:00100000:1.0:1789672914.406185:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714239872 00000100:00100000:1.0:1789672914.406246:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:1.0:1789672914.406259:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+48:11268:x1876607714239872:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789672914.406286:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672914.406310:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965526 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2507b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.406425:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996552d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.406441:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc40031000/0x6c78c4f8c9965511 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2506d expref: 49 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.406451:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996552d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.406483:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc40031000/0x6c78c4f8c9965511 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2506d expref: 49 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.406497:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc40031000/0x6c78c4f8c9965511 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2506d expref: 49 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672914.406537:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47984380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738450304:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672914.406691:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb467fb180 going to sleep for 11 seconds 00000100:00100000:1.0:1789672914.408297:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47984380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738450304:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672914.408323:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996552d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672914.409286:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.409342:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714240000 00000100:00100000:1.0:1789672914.409349:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714240000 00010000:00010000:1.0:1789672914.409380:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc40031000/0x6c78c4f8c9965511 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2506d expref: 50 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672914.409420:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:1.0:1789672914.409435:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc65c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+50:2395:x1876607714240000:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672914.409449:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672914.409456:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc40031000/0x6c78c4f8c9965511 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2506d expref: 50 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.409467:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc40031000/0x6c78c4f8c9965511 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2506d expref: 50 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.409495:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc40031000/0x6c78c4f8c9965511 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2506d expref: 50 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.409512:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:1.0:1789672914.409517:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996552d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.409541:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996552d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.409549:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996552d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.409619:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672914.409718:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc65c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+49:2395:x1876607714240000:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 288us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672914.409726:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 57 00010000:00010000:2.0:1789672914.410162:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996552d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.410169:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996552d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672914.410192:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789672914.410301:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc61609c00/0x6c78c4f8c9965526 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2507b expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.410313:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996552d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2507b expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.410318:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:2.0:1789672914.410319:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789672914.410321:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a1000, rc 0) 00000100:00100000:2.0:1789672914.410382:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+49:11268:x1876607714239872:12345-192.168.201.50@tcp:101:bash.0 Request processed in 4128us (4280us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789672914.410387:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:2.0:1789672914.412164:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.412231:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714240256 00000100:00100000:1.0:1789672914.412240:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714240256 00000100:00100000:1.0:1789672914.412319:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:1.0:1789672914.412327:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+49:11268:x1876607714240256:12345-192.168.201.50@tcp:36:bash.0 00010000:00010000:1.0:1789672914.412512:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c996553b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.412524:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c996553b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.412531:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c996553b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789672914.412589:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1789672914.412606:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000813e6aaa reply state 00000000c328e049 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c996553b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.412615:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c996553b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.412632:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:1.0:1789672914.412634:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789672914.412637:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789672914.412796:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+52:11268:x1876607714240256:12345-192.168.201.50@tcp:36:bash.0 Request processed in 469us (636us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1789672914.412801:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 68 00000020:00080000:1.0:1789672914.412805:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789672914.416776:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672914.416846:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714240384 00000100:00100000:3.0:1789672914.416866:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714240384 00000100:00100000:3.0:1789672914.417118:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:3.0:1789672914.417129:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+52:11268:x1876607714240384:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789672914.417155:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672914.417176:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965542 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25082 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.417261:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965549 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.417276:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996552d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2507b expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.417285:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965549 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.417319:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996552d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2507b expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.417329:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996552d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2507b expref: 53 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672914.417339:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc477daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738450432:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672914.417423:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4689e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789672914.419143:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc477daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738450432:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789672914.419164:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965549 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672914.420185:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.420361:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714240512 00000100:00100000:1.0:1789672914.420369:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714240512 00010000:00010000:1.0:1789672914.420398:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996552d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2507b expref: 54 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672914.420424:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:1.0:1789672914.420430:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+54:2395:x1876607714240512:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672914.420440:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672914.420446:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996552d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2507b expref: 54 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.420454:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996552d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2507b expref: 54 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.420471:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996552d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2507b expref: 54 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.420483:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:1.0:1789672914.420487:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965549 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.420505:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.420511:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965549 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.420530:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672914.420562:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.420570:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672914.420578:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+53:2395:x1876607714240512:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 147us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672914.420584:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 58 00000004:00200000:3.0:1789672914.420617:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789672914.420621:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789672914.420644:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.420693:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965542 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25082 expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.420709:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965549 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25082 expref: 52 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.420729:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:3.0:1789672914.420733:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672914.420736:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886800, rc 0) 00000100:00100000:3.0:1789672914.420762:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+52:11268:x1876607714240384:12345-192.168.201.50@tcp:101:bash.0 Request processed in 3637us (3998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672914.420769:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:2.0:1789672914.424256:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672914.424306:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714240768 00000100:00100000:3.0:1789672914.424330:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714240768 00000100:00100000:3.0:1789672914.424379:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:3.0:1789672914.424387:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f856850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+52:11268:x1876607714240768:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:3.0:1789672914.424573:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f856850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+53:11268:x1876607714240768:12345-192.168.201.50@tcp:35:bash.0 Request processed in 186us (326us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789672914.424582:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:2.0:1789672914.471867:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.472146:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714241024 00000100:00100000:1.0:1789672914.472156:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714241024 00000100:00100000:1.0:1789672914.472261:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 70 00000100:00100000:1.0:1789672914.472272:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+53:11279:x1876607714241024:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789672914.472299:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672914.472319:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc40031000/0x6c78c4f8c9965550 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25089 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672914.472422:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789672914.472529:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc40031000/0x6c78c4f8c9965550 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25089 expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.472544:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfb46b95c00) 00010000:00010000:1.0:1789672914.472548:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672914.472554:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc40031000/0x6c78c4f8c9965550 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25089 expref: 55 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.472570:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc40031000, rc 0) 00000100:00100000:1.0:1789672914.472641:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+54:11279:x1876607714241024:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 371us (785us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1789672914.472649:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 70 00000100:00100000:0.0:1789672914.474794:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.474903:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714241152 00000100:00100000:1.0:1789672914.474912:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714241152 00000100:00100000:1.0:1789672914.475010:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:1.0:1789672914.475021:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+54:11279:x1876607714241152:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:1.0:1789672914.475091:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996555e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475108:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996555e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475121:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996555e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475133:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965565 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475141:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475148:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475224:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996556c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475233:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996556c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475240:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996556c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789672914.475296:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996556c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475309:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996555e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475316:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996555e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475322:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996555e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475329:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a1000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672914.475333:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996555e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475341:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996555e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475352:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:1.0:1789672914.475355:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672914.475360:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996555e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475366:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c996555e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475377:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475383:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965565 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475394:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965565 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475399:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672914.475401:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965565 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475407:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965565 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475415:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfc4991c800) 00010000:00010000:1.0:1789672914.475417:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672914.475421:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965565 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475426:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965565 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475435:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996556c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475441:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996556c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475447:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996556c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475452:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672914.475454:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996556c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475470:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996556c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475478:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:1.0:1789672914.475481:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672914.475484:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996556c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.475490:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996556c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672914.475606:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+54:11279:x1876607714241152:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 587us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672914.475614:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:2.0:1789672914.477627:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672914.483941:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714241408 00000100:00100000:3.0:1789672914.483956:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714241408 00000100:00100000:3.0:1789672914.484063:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:3.0:1789672914.484075:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+54:11279:x1876607714241408:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789672914.484316:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+55:11279:x1876607714241408:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 243us (6694us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789672914.484324:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:3.0:1789672914.518581:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.518732:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714241664 00000100:00100000:0.0:1789672914.518744:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714241664 00000100:00100000:0.0:1789672914.518820:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:0.0:1789672914.518833:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+55:11282:x1876607714241664:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789672914.518858:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672914.518877:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965573 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25090 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.518953:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c996557a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.518987:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c996557a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519000:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c996557a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519012:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965581 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519020:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965581 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519027:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965581 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519608:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965588 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519620:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965588 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519627:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965588 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672914.519637:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789672914.519876:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c996557a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519884:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c996557a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519890:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c996557a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519904:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672914.519909:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c996557a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519918:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c996557a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519931:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:0.0:1789672914.519934:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672914.519939:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c996557a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519945:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c996557a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519959:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965581 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519966:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965581 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519972:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965581 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519977:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cca00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672914.519980:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965581 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.519985:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965581 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.520005:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfc4991c800) 00010000:00010000:0.0:1789672914.520008:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672914.520010:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965581 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.520016:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965581 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.520057:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965573 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25090 expref: 58 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.520147:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965588 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25090 expref: 57 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.520154:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:0.0:1789672914.520157:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789672914.520159:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cce00, rc 0) 00000100:00100000:0.0:1789672914.520596:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+57:11282:x1876607714241664:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 1765us (2021us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789672914.520606:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:2.0:1789672914.523963:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672914.524001:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.524095:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714241920 00000100:00100000:1.0:1789672914.524105:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714241920 00000100:00100000:1.0:1789672914.524169:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 73 00000100:00100000:1.0:1789672914.524179:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+57:11282:x1876607714241920:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:1.0:1789672914.524263:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965596 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.524280:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965596 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.524291:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965596 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.524322:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965596 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.524339:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965596 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.524345:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965596 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.524351:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672914.524355:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965596 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.524362:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965596 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.524372:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:1.0:1789672914.524375:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672914.524380:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965596 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.524386:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965596 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672914.524450:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+57:11282:x1876607714241920:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 273us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672914.524458:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 73 00000100:00100000:3.0:1789672914.527048:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714241792 00000100:00100000:3.0:1789672914.527063:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714241792 00000100:00100000:2.0:1789672914.527253:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.527407:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714242176 00000100:00100000:1.0:1789672914.527412:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714242176 00000100:00100000:1.0:1789672914.527469:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:1.0:1789672914.527479:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+57:11282:x1876607714242176:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:1.0:1789672914.527714:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:11282:x1876607714242176:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 236us (464us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789672914.527734:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:3.0:1789672914.530206:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:3.0:1789672914.530389:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f716300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:2395:x1876607714241792:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672914.530409:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672914.530433:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965588 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25090 expref: 58 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.530452:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:3.0:1789672914.530457:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672914.530571:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f716300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+57:2395:x1876607714241792:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 352us (6568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672914.530594:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:2.0:1789672914.635492:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.635740:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714242432 00000100:00100000:1.0:1789672914.635751:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714242432 00000100:00100000:1.0:1789672914.635888:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 74 00000100:00100000:1.0:1789672914.635907:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+57:11300:x1876607714242432:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:1.0:1789672914.635935:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672914.635955:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996559d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25097 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.636064:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c99655a4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.636079:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c99655a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.636090:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c99655a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672914.636101:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789672914.636397:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996559d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25097 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.636416:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c99655a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25097 expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.636443:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:2.0:1789672914.636446:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789672914.636449:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434800, rc 0) 00000100:00100000:2.0:1789672914.637149:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+59:11300:x1876607714242432:12345-192.168.201.50@tcp:101:cat.0 Request processed in 1242us (1663us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1789672914.637157:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 74 00000100:00100000:2.0:1789672914.661371:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.663070:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714242560 00000100:00100000:0.0:1789672914.663084:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714242560 00000100:00100000:0.0:1789672914.663161:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 75 00000100:00100000:0.0:1789672914.663172:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+59:11301:x1876607714242560:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789672914.663198:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672914.663219:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c99655b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2509e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.663325:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c99655b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.663340:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c99655b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.663352:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c99655b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672914.663393:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789672914.663396:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789672914.663414:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c99655b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.663440:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c99655b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2509e expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.663459:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c99655b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2509e expref: 60 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.663468:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:0.0:1789672914.663471:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672914.663474:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cca00, rc 0) 00000100:00100000:0.0:1789672914.664040:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:11301:x1876607714242560:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 867us (2676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672914.664048:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 75 00000100:00100000:1.0:1789672914.673214:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672914.673390:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714242944 00000100:00100000:3.0:1789672914.673400:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714242944 00000100:00100000:3.0:1789672914.673458:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:3.0:1789672914.673469:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:11301:x1876607714242944:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789672914.673788:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:11301:x1876607714242944:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 321us (585us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789672914.673797:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:2.0:1789672914.679967:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.680051:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714243072 00000100:00100000:0.0:1789672914.680061:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714243072 00000100:00100000:0.0:1789672914.680136:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:0.0:1789672914.680146:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f715c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:11301:x1876607714243072:12345-192.168.201.50@tcp:103:lfs.0 00010000:00010000:0.0:1789672914.680161:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789672914.680185:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965549 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25082 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.680208:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c99655a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25097 expref: 60 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.680221:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965446 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2503c expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.680231:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:0.0:1789672914.680236:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672914.680295:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f715c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:11301:x1876607714243072:12345-192.168.201.50@tcp:103:lfs.0 Request processed in 151us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672914.680303:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:2.0:1789672914.690586:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.690879:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714243200 00000100:00100000:0.0:1789672914.690890:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714243200 00000100:00100000:0.0:1789672914.690996:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 76 00000100:00100000:0.0:1789672914.691008:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:11301:x1876607714243200:12345-192.168.201.50@tcp:58:lfs.0 00010000:00010000:0.0:1789672914.691131:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c99655c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.691148:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c99655c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.691159:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c99655c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789672914.691411:0:11081:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789672914.691572:0:11081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789672914.691685:0:11081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789672914.691765:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:11301:x1876607714243200:12345-192.168.201.50@tcp:58:lfs.0 Request processed in 758us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672914.691773:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 76 00000040:00080000:1.0:1789672914.693015:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789672914.693021:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789672914.693059:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789672914.693065:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789672914.693283:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47986680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1876607738450560:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789672914.693363:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc6155af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789672914.705520:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.705754:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47986680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1876607738450560:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789672914.707120:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714243328 00000100:00100000:0.0:1789672914.707133:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714243328 00000100:00100000:0.0:1789672914.707202:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 77 00000100:00100000:0.0:1789672914.707212:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:11302:x1876607714243328:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789672914.707244:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789672914.707406:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:11302:x1876607714243328:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 194us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672914.707413:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 77 00000100:00100000:2.0:1789672914.712066:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.712193:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714243456 00000100:00100000:1.0:1789672914.712213:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714243456 00000100:00100000:1.0:1789672914.712455:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 78 00000100:00100000:1.0:1789672914.712466:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:11302:x1876607714243456:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789672914.712540:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99655c7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.712557:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99655c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.712569:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99655c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.712582:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99655ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.712590:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99655ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.712597:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99655ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.712620:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99655d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.712628:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99655d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.712635:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99655d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672914.712729:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789672914.712734:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789672914.712865:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99655d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.712879:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99655c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.712886:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99655c7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.712894:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99655c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.712900:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672914.712905:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99655c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.712912:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99655c7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.712924:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfc61501100) 00010000:00010000:1.0:1789672914.712927:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672914.712931:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99655c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.712938:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99655c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.713013:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99655ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.713020:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99655ce lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.713026:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99655ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.713038:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672914.713041:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99655ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.713048:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99655ce lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.713056:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8cfc61501700) 00010000:00010000:1.0:1789672914.713059:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672914.713061:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99655ce lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.713068:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99655ce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.713081:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99655d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.713087:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99655d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.713093:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99655d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.713098:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672914.713101:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99655d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.713108:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99655d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.713123:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:1.0:1789672914.713126:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672914.713129:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99655d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.713135:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99655d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672914.713208:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:11302:x1876607714243456:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 Request processed in 743us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672914.713216:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 78 00000100:00100000:2.0:1789672914.717125:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.717265:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714243712 00000100:00100000:0.0:1789672914.717275:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714243712 00000100:00100000:0.0:1789672914.717341:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 79 00000100:00100000:0.0:1789672914.717351:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:11302:x1876607714243712:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789672914.717371:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672914.717389:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99655dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd250a5 expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.717491:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99655e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.717505:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99655e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.717548:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99655e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672914.717559:0:11081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789672914.717649:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99655e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.717700:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99655e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.717708:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99655e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.717714:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cda00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672914.717717:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99655e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.717725:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99655e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.717737:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:0.0:1789672914.717740:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672914.717744:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99655e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.717751:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99655e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.717791:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99655dc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250a5 expref: 60 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.717825:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfc61501100) 00010000:00010000:0.0:1789672914.717827:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789672914.717832:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99655dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250a5 expref: 60 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.717841:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cc200, rc 0) 00000100:00100000:0.0:1789672914.717899:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+59:11302:x1876607714243712:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 549us (781us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1789672914.717906:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 79 00000100:00100000:2.0:1789672914.728106:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.729067:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714243840 00000100:00100000:0.0:1789672914.729079:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714243840 00000100:00100000:0.0:1789672914.729147:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 80 00000100:00100000:0.0:1789672914.729159:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+59:11302:x1876607714243840:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789672914.729301:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789672914.729457:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+59:11302:x1876607714243840:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 299us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672914.729465:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 80 00000100:00100000:2.0:1789672914.731073:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.732181:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714243968 00000100:00100000:1.0:1789672914.732760:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714243968 00000100:00100000:0.0:1789672914.733054:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 81 00000100:00100000:0.0:1789672914.733066:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+59:11304:x1876607714243968:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789672914.733084:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672914.733104:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c99655f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd250ac expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733170:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c99655f8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733311:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c99655f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733326:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c99655f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733340:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99655ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733348:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99655ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733355:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99655ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733430:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965606 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733440:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965606 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733447:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965606 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672914.733487:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789672914.733491:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789672914.733507:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965606 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733517:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965606 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733533:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c99655f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733540:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c99655f8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733546:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c99655f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733551:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672914.733555:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c99655f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733563:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c99655f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733574:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:0.0:1789672914.733577:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672914.733582:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c99655f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733589:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c99655f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733601:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99655ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733608:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99655ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733614:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99655ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733625:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8ccc00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672914.733629:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99655ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733635:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99655ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733644:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfc4991c800) 00010000:00010000:0.0:1789672914.733646:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672914.733649:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99655ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733872:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99655ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733903:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c99655f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ac expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733919:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965606 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ac expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.733927:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:0.0:1789672914.733930:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672914.733933:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cd800, rc 0) 00000100:00100000:0.0:1789672914.734103:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:11304:x1876607714243968:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 1038us (3034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672914.734111:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 81 00000100:00100000:2.0:1789672914.738007:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672914.738070:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714244224 00000100:00100000:3.0:1789672914.738080:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714244224 00000100:00100000:3.0:1789672914.738183:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 82 00000100:00100000:3.0:1789672914.738196:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:11302:x1876607714244224:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789672914.738217:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672914.738220:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789672914.738243:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c99655b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2509e expref: 60 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.738260:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:3.0:1789672914.738264:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672914.738276:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996560d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd250b3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789672914.738733:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789672914.738878:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965614 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.738901:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965614 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.738911:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965614 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.738965:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996560d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250b3 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.738979:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965614 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250b3 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.738986:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cfb419b0600) 00010000:00010000:3.0:1789672914.738989:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672914.738991:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886800, rc 0) 00000100:00100000:3.0:1789672914.739049:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:11302:x1876607714244224:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 857us (1050us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789672914.739057:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 82 00000100:00100000:2.0:1789672914.750850:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.750964:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714244480 00000100:00100000:0.0:1789672914.750987:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714244480 00000100:00100000:0.0:1789672914.751049:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 83 00000100:00100000:0.0:1789672914.751071:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:11302:x1876607714244480:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789672914.751128:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672914.751154:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965614 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250b3 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751174:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cfb419b0600) 00010000:00010000:0.0:1789672914.751183:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672914.751204:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965622 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751216:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965622 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751225:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965622 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751275:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965629 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x8cabe1a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751283:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8cabe1a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751290:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8cabe1a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751330:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965622 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751337:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965622 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751351:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965622 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751357:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672914.751361:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965622 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751370:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965622 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751377:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:0.0:1789672914.751380:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672914.751383:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965622 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751389:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965622 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751397:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8cabe1a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751415:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965629 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8cabe1a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751422:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965629 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8cabe1a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751427:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8ccc00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672914.751429:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965629 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8cabe1a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751446:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965629 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8cabe1a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751455:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x8cabe1a5 (ffff8cfb46b95000) 00010000:00010000:0.0:1789672914.751457:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672914.751460:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965629 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8cabe1a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.751466:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965629 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8cabe1a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672914.751555:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:11302:x1876607714244480:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 487us (715us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789672914.751563:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 83 00000100:00100000:2.0:1789672914.755939:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672914.755963:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc477dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738450688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789672914.756035:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672914.756217:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738450688 00000100:00100000:3.0:1789672914.756227:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738450688 00000100:00100000:3.0:1789672914.756285:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789672914.756295:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738450688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789672914.756323:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672914.756370:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738450688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672914.756377:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789672914.756428:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc477dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738450688:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1789672914.757522:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789672914.757811:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789672914.757826:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738450816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672914.757876:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672914.757979:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738450816 00000100:00100000:2.0:1789672914.757986:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738450816 00000100:00100000:2.0:1789672914.758016:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789672914.758024:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738450816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789672914.758039:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672914.758096:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738450816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672914.758111:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789672914.758230:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738450816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672914.760940:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.761202:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714244608 00000100:00100000:0.0:1789672914.761212:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714244608 00000100:00100000:0.0:1789672914.761271:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 84 00000100:00100000:0.0:1789672914.761283:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:11302:x1876607714244608:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789672914.761303:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672914.761327:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965630 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd250ba expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.761367:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965637 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.761396:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.761423:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.761548:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965630 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ba expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.761567:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965637 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ba expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.761575:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cfb46b95000) 00010000:00010000:0.0:1789672914.761578:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789672914.761582:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cc800, rc 0) 00000100:00100000:0.0:1789672914.762528:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:11302:x1876607714244608:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 1243us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672914.762537:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 84 00000100:00100000:3.0:1789672914.766715:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.766820:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714244864 00000100:00100000:0.0:1789672914.766831:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714244864 00000100:00100000:0.0:1789672914.766899:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 85 00000100:00100000:0.0:1789672914.766910:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:11302:x1876607714244864:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789672914.766993:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996563e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.767013:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996563e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.767043:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996563e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789672914.767240:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1789672914.767251:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 392682591597ns, next at 393682588374ns, rc = 0 00000004:00010000:0.0:1789672914.767299:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000ea4d69 reply state 00000000f0587cb0 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996563e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.767312:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996563e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.767320:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cfb46b95000) 00010000:00010000:0.0:1789672914.767323:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789672914.767326:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789672914.767443:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:11302:x1876607714244864:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 535us (737us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789672914.767451:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 85 00000100:00100000:2.0:1789672914.779172:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.779399:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714244992 00000100:00100000:0.0:1789672914.779422:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714244992 00000100:00100000:0.0:1789672914.779531:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 86 00000100:00100000:0.0:1789672914.779543:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:11302:x1876607714244992:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789672914.779569:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672914.779590:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965645 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd250c1 expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.779697:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965645 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250c1 expref: 64 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.779732:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965645 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250c1 expref: 64 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.779754:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cfb46b95000) 00010000:00010000:0.0:1789672914.779757:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789672914.779761:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8ccc00, rc 0) 00000100:00100000:0.0:1789672914.779826:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+64:11302:x1876607714244992:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 285us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672914.779834:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 86 00000100:00100000:1.0:1789672914.787585:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.787849:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714245120 00000100:00100000:0.0:1789672914.787859:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714245120 00000100:00100000:0.0:1789672914.787911:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:0.0:1789672914.787920:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1876607714245120:12345-192.168.201.50@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1789672914.789010:0:8429:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp t0 exp 0000000000000000 cur 392 last 0 00000020:00000080:0.0:1789672914.789066:0:8429:0:(genops.c:1384:class_connect()) connect: client ad795a16-0aa4-4e04-82a0-6f12aab5f2ea, cookie 0x6c78c4f8c996564c 00002000:00100000:0.0:1789672914.789078:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ad795a16-0aa4-4e04-82a0-6f12aab5f2ea/ffff8cfb48119800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789672914.789091:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789672914.789173:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789672914.789203:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8cfb4811d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789672914.789897:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2394:x1876607714245120:12345-192.168.201.50@tcp:8:lhsmtool_posix.0 Request processed in 1975us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672914.789907:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:3.0:1789672914.798961:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.799355:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714245248 00000100:00100000:0.0:1789672914.799366:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714245248 00000100:00100000:0.0:1789672914.799462:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:0.0:1789672914.799472:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:0:x1876607714245248:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789672914.799728:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789672914.801317:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1789672914.801332:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000100:00100000:0.0:1789672914.801565:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:0:x1876607714245248:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 2089us (2608us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789672914.801576:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:3.0:1789672914.805363:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.805487:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714245504 00000100:00100000:1.0:1789672914.805495:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714245504 00000100:00100000:1.0:1789672914.805545:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:1.0:1789672914.805556:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+64:11302:x1876607714245504:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789672914.805847:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:11302:x1876607714245504:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 292us (492us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1789672914.805856:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:2.0:1789672914.807877:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.807968:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714245760 00000100:00100000:0.0:1789672914.807977:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714245760 00000100:00100000:0.0:1789672914.808031:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 87 00000100:00100000:0.0:1789672914.808040:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:11302:x1876607714245760:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789672914.808137:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:11302:x1876607714245760:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 98us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672914.808144:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 87 00000100:00100000:3.0:1789672914.813564:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672914.813694:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714245888 00000100:00100000:2.0:1789672914.813705:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714245888 00000100:00100000:2.0:1789672914.813982:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 88 00000100:00100000:2.0:1789672914.813994:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:11302:x1876607714245888:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672914.814015:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672914.814035:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965653 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd250c8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.814105:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996565a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.814120:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996565a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.814132:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996565a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672914.814181:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789672914.814215:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996565a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.814256:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965653 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250c8 expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.814274:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996565a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250c8 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.814283:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cfb46b95000) 00010000:00010000:2.0:1789672914.814286:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789672914.814290:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef800, rc 0) 00000100:00100000:2.0:1789672914.814352:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+66:11302:x1876607714245888:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 361us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672914.814360:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 88 00000100:00100000:3.0:1789672914.817415:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.817534:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714246016 00000100:00100000:0.0:1789672914.817544:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714246016 00000100:00100000:0.0:1789672914.817598:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:0.0:1789672914.817608:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714246016:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789672914.817625:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672914.817644:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a041e251/0x6c78c4f8c9965661 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd250cf expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789672914.817695:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac3dd1, blocks: 0x0 00010000:00010000:0.0:1789672914.817733:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=392s v=(0 0) 00010000:00010000:0.0:1789672914.817738:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672914.817746:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a041e251/0x6c78c4f8c9965661 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250cf expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.817791:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a041e251/0x6c78c4f8c9965661 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250cf expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.817813:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cc200, rc 0) 00000100:00100000:0.0:1789672914.817859:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714246016:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 253us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672914.817865:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:3.0:1789672914.828491:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.828575:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714246272 00000100:00100000:0.0:1789672914.828584:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714246272 00000100:00100000:0.0:1789672914.828646:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 89 00000100:00100000:0.0:1789672914.828685:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+66:11302:x1876607714246272:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789672914.828792:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+66:11302:x1876607714246272:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 136us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672914.828807:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 89 00000100:00100000:3.0:1789672914.840391:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.846453:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714246400 00000100:00100000:0.0:1789672914.846468:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714246400 00000100:00100000:0.0:1789672914.846539:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:0.0:1789672914.846551:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:11302:x1876607714246400:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789672914.846571:0:8494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672914.846593:0:8494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a24e6ee3/0x6c78c4f8c9965668 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd250d6 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.846625:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a041e251/0x6c78c4f8c9965661 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250cf expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.846647:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672914.846652:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672914.846675:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a24e6ee3/0x6c78c4f8c9965668 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250d6 expref: 7 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.846782:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a041e251/0x6c78c4f8c9965661 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250cf expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.846798:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a041e251/0x6c78c4f8c9965661 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250cf expref: 7 pid: 8430 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672914.846823:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f678380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8494:1876607738450944:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789672914.847251:0:8494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc44cc1000 going to sleep for 11 seconds 00000100:00100000:0.0:1789672914.851204:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f678380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8494:1876607738450944:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789672914.851245:0:8494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a24e6ee3/0x6c78c4f8c9965668 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250d6 expref: 7 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.851266:0:8494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cda00, rc 0) 00000100:00100000:0.0:1789672914.851356:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:11302:x1876607714246400:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 4807us (10974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672914.851365:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:1.0:1789672914.854018:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.854051:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714246528 00000100:00100000:1.0:1789672914.854059:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714246528 00010000:00010000:1.0:1789672914.854093:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a041e251/0x6c78c4f8c9965661 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250cf expref: 7 pid: 8430 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672914.854126:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:1.0:1789672914.854134:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47985500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714246528:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672914.854159:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672914.854178:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a041e251/0x6c78c4f8c9965661 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250cf expref: 7 pid: 8430 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.854192:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a041e251/0x6c78c4f8c9965661 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250cf expref: 7 pid: 8430 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.854214:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a041e251/0x6c78c4f8c9965661 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250cf expref: 7 pid: 8430 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.854231:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672914.854235:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672914.854243:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a24e6ee3/0x6c78c4f8c9965668 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250d6 expref: 6 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.854253:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a24e6ee3/0x6c78c4f8c9965668 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250d6 expref: 6 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.854285:0:7920:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a24e6ee3/0x6c78c4f8c9965668 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250d6 expref: 6 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672914.854298:0:7920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47985880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7920:1876607738451072:192.168.201.50@tcp:105: 00000100:00100000:1.0:1789672914.854355:0:7920:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc464a5480 going to sleep for 11 seconds 00000100:00100000:1.0:1789672914.858523:0:7920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47985880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7920:1876607738451072:192.168.201.50@tcp:105: 00010000:00010000:1.0:1789672914.858550:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672914.858719:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47985500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714246528:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 4583us (4707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672914.858730:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:0.0:1789672914.858887:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.859036:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714246656 00000100:00100000:1.0:1789672914.859043:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714246656 00002000:00100000:1.0:1789672914.859081:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8cfc7f678380 x1876607714246656/t0(0) o4->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:540/0 lens 504/0 e 0 to 0 dl 1789672925 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789672914.859091:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfc7f678380 with x1876607714246656 ext(0->8) 00002000:00010000:1.0:1789672914.859096:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfc7f678380 00000100:00100000:1.0:1789672914.859616:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:1.0:1789672914.859628:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2397:x1876607714246656:12345-192.168.201.50@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789672914.860623:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2397:x1876607714246656:12345-192.168.201.50@tcp:4:lhsmtool_posix.0 Request processed in 994us (1732us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789672914.860633:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00002000:00100000:1.0:1789672914.860641:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8cfc7f678380 x1876607714246656/t4294967303(0) o4->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:540/0 lens 504/448 e 0 to 0 dl 1789672925 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789672914.860650:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfc7f678380 with x1876607714246656 ext(0->8) 00002000:00010000:1.0:1789672914.860680:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfc7f678380 00000100:00100000:0.0:1789672914.867355:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672914.867413:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714246784 00000100:00100000:3.0:1789672914.867422:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714246784 00000100:00100000:3.0:1789672914.867468:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 90 00000100:00100000:3.0:1789672914.867476:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+66:11302:x1876607714246784:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789672914.871608:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1789672914.871624:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:0.0:1789672914.871634:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c9965382 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871653:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c9965382 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871683:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c9965382 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871689:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cdc00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672914.871694:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c9965382 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871702:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c9965382 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789672914.871713:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1789672914.871718:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cfb46b95b00) 00010000:00010000:0.0:1789672914.871721:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672914.871727:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c9965382 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789672914.871728:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfb4689ec00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789672914.871732:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc66ff1600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfb4689e6c0 00010000:00010000:0.0:1789672914.871733:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c9965382 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789672914.871736:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc66ff1f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cfb41a2be00 00010000:00010000:0.0:1789672914.871750:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965389 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871755:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965389 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871761:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965389 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871765:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672914.871773:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965389 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871779:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965389 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871786:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:0.0:1789672914.871789:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672914.871792:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965389 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871797:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965389 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871824:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99653c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871830:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99653c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871836:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99653c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871840:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aee200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672914.871843:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99653c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672914.871908:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:11302:x1876607714246784:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 Request processed in 4428us (4559us total) trans 0 rc 0/0 00010000:00010000:0.0:1789672914.871911:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99653c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672914.871917:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 90 00010000:00010000:0.0:1789672914.871919:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfc4991c800) 00010000:00010000:0.0:1789672914.871921:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672914.871929:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99653c8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871935:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c99653c8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871949:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c99654d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871955:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c99654d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871960:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c99654d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871965:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672914.871967:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c99654d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871973:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c99654d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871980:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:0.0:1789672914.871982:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672914.871984:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c99654d2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871989:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c99654d2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.871997:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99654f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872002:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99654f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872013:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99654f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872017:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672914.872020:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99654f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872025:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99654f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872033:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:0.0:1789672914.872035:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672914.872038:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99654f5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872043:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c99654f5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872054:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c996553b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872060:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c996553b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872066:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c996553b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872071:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a1a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672914.872073:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c996553b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872089:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c996553b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872102:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:0.0:1789672914.872104:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672914.872107:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c996553b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872113:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c996553b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872124:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996563e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872131:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996563e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872136:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996563e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872140:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672914.872143:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996563e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872152:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996563e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872159:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cfb46b95000) 00010000:00010000:0.0:1789672914.872161:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789672914.872164:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996563e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872176:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996563e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789672914.872214:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:0.0:1789672914.872228:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672914.872242:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47b81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738451200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789672914.872285:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672914.872315:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672914.872323:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738451328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789672914.872344:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1789672914.872362:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789672914.872368:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738451200 00000100:00100000:0.0:1789672914.872375:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738451200 00000100:00100000:0.0:1789672914.872412:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738451328 00000100:00100000:0.0:1789672914.872415:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738451328 00000100:00100000:0.0:1789672914.872435:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789672914.872443:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738451200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789672914.872526:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789672914.872529:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789672913 00002000:00010000:0.0:1789672914.872532:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789672914.872534:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789672913 -> 1789672913 00002000:00010000:0.0:1789672914.872536:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789672914.872566:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1876607738451200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (280us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789672914.872573:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789672914.872585:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789672914.872592:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1876607738451328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789672914.872605:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1789672914.872634:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aac3dcf, atime: 0x6aac3dcf, ctime: 0x6aac3dcf, blocks: 0x8 00010000:00010000:0.0:1789672914.872641:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003790b83/0x6c78c4f8c996566f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872655:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=392s v=(0 0) 00010000:00010000:0.0:1789672914.872677:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672914.872684:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003790b83/0x6c78c4f8c996566f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872701:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003790b83/0x6c78c4f8c996566f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872710:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003790b83/0x6c78c4f8c996566f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872717:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003790b83/0x6c78c4f8c996566f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872733:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789672914.872839:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3636:x1876607738451328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 248us (494us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789672914.872912:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1789672914.872937:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672914.872944:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003790b83/0x6c78c4f8c996566f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872952:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cce00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789672914.872961:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003790b83/0x6c78c4f8c996566f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872970:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003790b83/0x6c78c4f8c996566f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872982:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003790b83/0x6c78c4f8c996566f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.872990:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003790b83/0x6c78c4f8c996566f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.873005:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672914.873007:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672914.873008:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789672914.873033:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfc7f67a300/2, rc 0, transno 4294967302 00000100:00100000:0.0:1789672914.873039:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738451328:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1789672914.873057:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfb47b81c00/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789672914.873062:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47b81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738451200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789672914.875351:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.875436:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714246912 00000100:00100000:0.0:1789672914.875446:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714246912 00000100:00100000:0.0:1789672914.875529:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 38 00000100:00100000:0.0:1789672914.875540:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2398:x1876607714246912:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789672914.879287:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1789672914.879313:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1789672914.879522:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714246912:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 Request processed in 3978us (4173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672914.879534:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 38 00000100:00100000:3.0:1789672914.883584:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672914.883736:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714247168 00000100:00100000:2.0:1789672914.883747:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714247168 00000100:00100000:2.0:1789672914.883860:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 91 00000100:00100000:2.0:1789672914.883873:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+14:11302:x1876607714247168:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789672914.883928:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672914.883966:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996565a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250c8 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.883983:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cfb46b95000) 00010000:00010000:2.0:1789672914.883989:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672914.884020:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965676 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.884040:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965676 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.884051:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965676 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789672914.884196:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e25df78 reply state 00000000d105db65 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965676 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.884209:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965676 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.884216:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cfb46b95000) 00010000:00010000:2.0:1789672914.884220:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789672914.884222:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789672914.884316:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+15:11302:x1876607714247168:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 447us (743us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1789672914.884324:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 91 00000100:00100000:1.0:1789672914.890939:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.891547:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714247296 00000100:00100000:0.0:1789672914.891558:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714247296 00000100:00100000:0.0:1789672914.891625:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:0.0:1789672914.891635:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2397:x1876607714247296:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789672914.891829:0:8494:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789672914.891833:0:8494:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789672913 -> 1789672912 00002000:00010000:0.0:1789672914.891836:0:8494:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789672911 00002000:00010000:0.0:1789672914.891839:0:8494:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789672913 -> 1789672912 00002000:00010000:0.0:1789672914.891841:0:8494:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789672914.891896:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2397:x1876607714247296:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 262us (968us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789672914.891903:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:3.0:1789672914.902465:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672914.902539:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714247552 00000100:00100000:2.0:1789672914.902549:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714247552 00000100:00100000:2.0:1789672914.902607:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 92 00000100:00100000:2.0:1789672914.902619:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+15:11302:x1876607714247552:12345-192.168.201.50@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789672914.902726:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996567d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.902742:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965637 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ba expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.902751:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996567d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.902792:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965637 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ba expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.902818:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965637 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ba expref: 15 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672914.902832:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47b82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738451456:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789672914.902915:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672914.906774:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47b82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738451456:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789672914.906815:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996567d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672914.911433:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.911509:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714247680 00000100:00100000:0.0:1789672914.911518:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714247680 00010000:00010000:0.0:1789672914.911559:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965637 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ba expref: 16 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672914.911605:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:0.0:1789672914.911616:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+16:2396:x1876607714247680:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672914.911630:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672914.911637:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965637 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ba expref: 16 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.911651:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965637 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ba expref: 16 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.911702:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965637 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ba expref: 16 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.911721:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cfb46b95000) 00010000:00010000:0.0:1789672914.911727:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996567d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.911737:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996567d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.911756:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996567d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.911787:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672914.911815:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996567d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.911825:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996567d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672914.911854:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+15:2396:x1876607714247680:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 239us (429us total) trans 0 rc 0/0 00010000:00010000:3.0:1789672914.911862:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996567d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672914.911863:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 60 00010000:00010000:3.0:1789672914.911871:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996567d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.911876:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996567d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.911880:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aef800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672914.911884:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996567d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.911889:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996567d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.911895:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cfb46b95000) 00010000:00010000:3.0:1789672914.911897:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789672914.911900:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996567d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.911904:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c996567d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672914.911939:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+14:11302:x1876607714247552:12345-192.168.201.50@tcp:55:lhsmtool_posix.0 Request processed in 9323us (9483us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789672914.911953:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 92 00000100:00100000:0.0:1789672914.919047:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672914.919225:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714247808 00000100:00100000:2.0:1789672914.919236:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714247808 00000100:00100000:2.0:1789672914.919322:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 40 00000100:00100000:2.0:1789672914.919334:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2398:x1876607714247808:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789672914.919378:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9965684 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.919399:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a24e6ee3/0x6c78c4f8c9965668 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250d6 expref: 7 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.919408:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672914.919412:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789672914.919417:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9965684 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.919467:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a24e6ee3/0x6c78c4f8c9965668 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250d6 expref: 7 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.919479:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a24e6ee3/0x6c78c4f8c9965668 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250d6 expref: 7 pid: 8494 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672914.919494:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47b82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876607738451584:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789672914.919573:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672914.924417:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47b82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876607738451584:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789672914.924448:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9965684 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672914.926198:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.926274:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714247936 00000100:00100000:1.0:1789672914.926281:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714247936 00010000:00010000:1.0:1789672914.926316:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a24e6ee3/0x6c78c4f8c9965668 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250d6 expref: 8 pid: 8494 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672914.926355:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:1.0:1789672914.926364:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2396:x1876607714247936:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672914.926383:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672914.926403:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a24e6ee3/0x6c78c4f8c9965668 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250d6 expref: 8 pid: 8494 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.926423:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a24e6ee3/0x6c78c4f8c9965668 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250d6 expref: 8 pid: 8494 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.926440:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a24e6ee3/0x6c78c4f8c9965668 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250d6 expref: 8 pid: 8494 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.926452:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789672914.926456:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789672914.926460:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9965684 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.926467:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9965684 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.926490:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672914.926533:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714247936:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 171us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672914.926539:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 61 00010000:00010000:2.0:1789672914.926822:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9965684 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.926834:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9965684 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.926861:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9965684 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.926870:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9965684 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.926890:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9965684 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.926898:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aeec00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789672914.926902:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9965684 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.926913:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9965684 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.926927:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9965684 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672914.926935:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9965684 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672914.927013:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714247808:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 Request processed in 7682us (7975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672914.927022:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 40 00000100:00100000:0.0:1789672914.935240:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.935325:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714248192 00000100:00100000:1.0:1789672914.935334:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714248192 00000100:00100000:1.0:1789672914.935381:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 93 00000100:00100000:1.0:1789672914.935389:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+14:11302:x1876607714248192:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789672914.935460:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c996568b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.935474:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99654cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2505f expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.935482:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c996568b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.935507:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99654cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2505f expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.935517:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99654cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2505f expref: 14 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672914.935531:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47985c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738451712:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672914.935646:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc464a5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789672914.937538:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47985c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738451712:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789672914.937565:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c996568b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672914.939262:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.939424:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714248320 00000100:00100000:1.0:1789672914.939434:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714248320 00010000:00010000:1.0:1789672914.939464:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99654cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2505f expref: 15 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672914.939497:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:1.0:1789672914.939507:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc65c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+15:2395:x1876607714248320:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672914.939522:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672914.939528:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99654cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2505f expref: 15 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.939553:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99654cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2505f expref: 15 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.939574:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c99654cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2505f expref: 15 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.939585:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:1.0:1789672914.939590:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c996568b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.939596:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c996568b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.939602:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c996568b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.939621:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672914.939641:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c996568b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.939649:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c996568b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672914.939687:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc65c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+14:2395:x1876607714248320:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 180us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672914.939694:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 62 00010000:00010000:3.0:1789672914.939844:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965692 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.939856:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965645 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250c1 expref: 14 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.939865:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965692 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.939894:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965645 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250c1 expref: 14 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.939907:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965645 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250c1 expref: 14 pid: 11081 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672914.939920:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc477da680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738451840:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672914.939966:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc412edd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789672914.943695:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc477da680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738451840:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789672914.943739:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965692 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672914.944545:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.944608:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714248448 00000100:00100000:1.0:1789672914.944617:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714248448 00010000:00010000:1.0:1789672914.944649:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965645 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250c1 expref: 15 pid: 11081 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672914.944885:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:1.0:1789672914.944895:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+15:2396:x1876607714248448:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672914.944918:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672914.944926:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965645 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250c1 expref: 15 pid: 11081 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.944948:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965645 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250c1 expref: 15 pid: 11081 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.944970:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965645 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250c1 expref: 15 pid: 11081 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.944982:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cfb46b95000) 00010000:00010000:1.0:1789672914.944986:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965692 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.944996:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965692 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.945004:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965692 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.945034:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672914.945085:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+14:2396:x1876607714248448:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 191us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672914.945092:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 63 00010000:00010000:3.0:1789672914.945136:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965692 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.945153:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965692 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789672914.945252:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1789672914.945365:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1789672914.945399:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1789672914.945470:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc477d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1876607738451968:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789672914.945520:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672914.945553:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4164af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789672914.945575:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738451968 00000100:00100000:3.0:1789672914.945579:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738451968 00000100:00100000:3.0:1789672914.945609:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789672914.945616:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1876607738451968:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789672914.945710:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1876607738451968:12345-0@lo:1000:mdt00_002.0 Request processed in 95us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672914.945716:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789672914.945758:0:6514:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789672914.945763:0:6514:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfb47b81c00, transno 4294967304 00000100:00100000:3.0:1789672914.945775:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc477d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1876607738451968:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789672914.945893:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1789672914.945924:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc477d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1876607738452096:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789672914.945957:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672914.945971:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb479ee840 going to sleep for 11 seconds 00000100:00100000:3.0:1789672914.945983:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738452096 00000100:00100000:3.0:1789672914.945986:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738452096 00000100:00100000:3.0:1789672914.946004:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789672914.946009:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1876607738452096:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789672914.946085:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6514:x1876607738452096:12345-0@lo:1000:mdt00_002.0 Request processed in 74us (126us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789672914.946091:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789672914.946116:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc477d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1876607738452096:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789672914.946137:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965692 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946145:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965692 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946152:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965692 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946158:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672914.946162:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965692 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946169:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965692 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946179:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cfb46b95000) 00010000:00010000:3.0:1789672914.946182:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789672914.946185:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965692 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946191:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965692 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946214:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c99655c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946229:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c99655c0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946235:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c99655c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946240:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672914.946243:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c99655c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946249:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c99655c0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946257:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:3.0:1789672914.946259:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789672914.946262:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c99655c0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946267:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c99655c0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946285:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965699 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946296:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965606 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ac expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946304:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965699 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946323:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965606 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ac expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672914.946339:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965606 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ac expref: 17 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672914.946350:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f603b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738452224:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672914.946389:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb479ee840 going to sleep for 11 seconds 00000100:00100000:1.0:1789672914.948927:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f603b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738452224:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672914.949013:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965699 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672914.951849:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672914.951890:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714248576 00000100:00100000:0.0:1789672914.951902:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714248576 00010000:00010000:0.0:1789672914.951944:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965606 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ac expref: 18 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672914.951986:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:0.0:1789672914.951997:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f603b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+18:2396:x1876607714248576:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672914.952012:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672914.952020:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965606 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ac expref: 18 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.952048:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965606 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ac expref: 18 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.952068:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965606 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250ac expref: 18 pid: 6512 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.952081:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:0.0:1789672914.952088:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965699 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.952098:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965699 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.952105:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965699 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.952133:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672914.952207:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965699 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.952222:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965699 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.952236:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965699 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.952243:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965699 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672914.952243:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f603b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+17:2396:x1876607714248576:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 198us (353us total) trans 0 rc 0/0 00010000:00010000:1.0:1789672914.952251:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965699 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672914.952252:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 64 00010000:00010000:1.0:1789672914.952256:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672914.952261:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965699 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.952268:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965699 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.952277:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:1.0:1789672914.952280:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672914.952283:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965699 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.952289:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965699 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.952301:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c996568b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.952306:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c996568b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.952314:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c996568b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.952318:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672914.952319:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c996568b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.952323:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c996568b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.952328:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc4991c700) 00010000:00010000:1.0:1789672914.952329:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789672914.952331:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c996568b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.952334:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c996568b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672914.952460:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+16:11302:x1876607714248192:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 17070us (17239us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789672914.952468:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 93 00000020:00080000:1.0:1789672914.952471:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789672914.952589:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789672914.952594:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789672914.952613:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789672914.952620:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789672914.954758:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672914.955116:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714248832 00000100:00100000:1.0:1789672914.955125:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714248832 00000100:00100000:1.0:1789672914.955212:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:1.0:1789672914.955222:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+16:11302:x1876607714248832:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789672914.955454:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789672914.955482:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1789672914.955525:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99656a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.955541:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99656a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.955552:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99656a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.955561:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99656a0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.955567:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99656a0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.955573:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99656a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672914.955596:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789672914.955696:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+18:11302:x1876607714248832:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 475us (1046us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789672914.955704:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000020:00080000:1.0:1789672914.955709:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789672914.955809:0:13186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672914.955816:0:13186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99656a0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.955834:0:13186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434600 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789672914.955838:0:13186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99656a0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.955847:0:13186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99656a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.955860:0:13186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cfb46b95000) 00010000:00010000:0.0:1789672914.955862:0:13186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789672914.955867:0:13186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99656a0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.955873:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99656a0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672914.955884:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672914.955885:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672914.955887:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672915.145280:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789672915.658461:0:14206:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789672915.658470:0:14206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789672915.658494:0:14206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789672915.658499:0:14206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789672915.779836:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672915.779858:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738452352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789672915.779927:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672915.781408:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672915.781543:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714249088 00000100:00100000:0.0:1789672915.781553:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714249088 00000100:00100000:0.0:1789672915.781616:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 94 00000100:00100000:0.0:1789672915.781625:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+18:11324:x1876607714249088:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789672915.781649:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672915.781695:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c99656a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd250dd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.781809:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c99656ae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.781824:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c99656ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.781847:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c99656ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672915.781859:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789672915.781959:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c99656a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250dd expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.781978:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c99656ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250dd expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.781987:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:0.0:1789672915.781990:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789672915.781994:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cdc00, rc 0) 00000100:00100000:0.0:1789672915.782062:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:11324:x1876607714249088:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 438us (670us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789672915.782070:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 94 00000100:00100000:2.0:1789672915.782429:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738452352 00000100:00100000:2.0:1789672915.782436:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738452352 00000100:00100000:0.0:1789672915.782555:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789672915.782563:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738452352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789672915.782586:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789672915.782643:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738452352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (2715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672915.782649:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789672915.782827:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738452352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789672915.786211:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672915.786286:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714249216 00000100:00100000:3.0:1789672915.786294:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714249216 00000100:00100000:3.0:1789672915.786346:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 95 00000100:00100000:3.0:1789672915.786355:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:11324:x1876607714249216:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:3.0:1789672915.786423:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c99656bc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786440:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c99656bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786451:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c99656bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786465:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c99656c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786488:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c99656c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786494:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c99656c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786563:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c99656ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786570:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c99656ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786577:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c99656ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672915.786615:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c99656ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786626:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c99656bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786633:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c99656bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786640:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c99656bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786646:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672915.786650:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c99656bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786700:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c99656bc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786717:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:3.0:1789672915.786720:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672915.786725:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c99656bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786731:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c99656bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786745:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c99656c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786751:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c99656c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786757:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c99656c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786762:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672915.786765:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c99656c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786771:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c99656c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786776:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfb419b0a00) 00010000:00010000:3.0:1789672915.786779:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672915.786781:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c99656c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786797:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c99656c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786818:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c99656ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786825:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c99656ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786830:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c99656ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786835:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672915.786838:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c99656ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786843:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c99656ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786850:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfb419b0d00) 00010000:00010000:3.0:1789672915.786852:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672915.786854:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c99656ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672915.786859:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c99656ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672915.786982:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:11324:x1876607714249216:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 628us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672915.786990:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 95 00000100:00100000:3.0:1789672915.859525:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672915.859833:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714249472 00000100:00100000:1.0:1789672915.859843:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714249472 00000100:00100000:1.0:1789672915.859907:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 96 00000100:00100000:1.0:1789672915.859917:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:11327:x1876607714249472:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789672915.860059:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672915.860082:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99656d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd250e4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.860155:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99656d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.860171:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99656d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.860183:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99656d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.860209:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c99656df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.860217:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c99656df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.860761:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c99656df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.860897:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99656e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.860907:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99656e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.860914:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99656e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672915.860996:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789672915.861081:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99656d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.861090:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99656d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.861097:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99656d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.861103:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672915.861108:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99656d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.861117:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99656d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.861128:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:1.0:1789672915.861132:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672915.861137:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99656d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.861144:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c99656d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.861157:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c99656df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.861163:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c99656df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.861169:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c99656df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.861173:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672915.861183:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c99656df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.861202:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c99656df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.861212:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfc61501700) 00010000:00010000:1.0:1789672915.861215:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672915.861218:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c99656df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.861225:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c99656df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.861270:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99656d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250e4 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.861285:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99656e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250e4 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.861292:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc61501300) 00010000:00010000:1.0:1789672915.861295:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672915.861298:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434200, rc 0) 00000100:00100000:1.0:1789672915.861444:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:11327:x1876607714249472:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 1528us (1928us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789672915.861452:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 96 00000100:00100000:3.0:1789672915.882417:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672915.884997:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714249600 00000100:00100000:1.0:1789672915.885010:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714249600 00000100:00100000:1.0:1789672915.885071:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 97 00000100:00100000:1.0:1789672915.885080:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:11327:x1876607714249600:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:1.0:1789672915.885157:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99656f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.885170:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99656f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.885178:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99656f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.885497:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99656f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.885503:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99656f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.885516:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99656f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.885521:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672915.885524:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99656f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.885529:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99656f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.885539:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc61501300) 00010000:00010000:0.0:1789672915.885541:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789672915.885544:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99656f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.885548:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99656f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672915.885623:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:11327:x1876607714249600:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 542us (3216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672915.885632:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 97 00000100:00100000:2.0:1789672915.888246:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672915.888376:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714249856 00000100:00100000:3.0:1789672915.888397:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714249856 00000100:00100000:3.0:1789672915.888454:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:3.0:1789672915.888465:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f852050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:11327:x1876607714249856:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789672915.888734:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f852050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+23:11327:x1876607714249856:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 270us (495us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1789672915.888742:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:3.0:1789672915.920029:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672915.920068:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672915.920106:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672915.920136:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672915.920160:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672915.920164:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714250496 00000100:00100000:0.0:1789672915.920175:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714250496 00000100:00100000:0.0:1789672915.920228:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714250112 00000100:00100000:0.0:1789672915.920231:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714250112 00000100:00100000:0.0:1789672915.920255:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 302 00000100:00100000:0.0:1789672915.920267:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714250496:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672915.920393:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714249984 00000100:00100000:1.0:1789672915.920398:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714249984 00000100:00100000:1.0:1789672915.920430:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 386 00000100:00100000:1.0:1789672915.920437:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2396:x1876607714249984:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672915.920479:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672915.920516:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714250496:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 250us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672915.920533:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 302 00000100:00100000:0.0:1789672915.920548:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714250624 00000100:00100000:0.0:1789672915.920551:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714250624 00000100:00100000:0.0:1789672915.920579:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 303 00000100:00100000:0.0:1789672915.920585:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714250112:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672915.920652:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714250240 00000100:00100000:2.0:1789672915.920683:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714250240 00000100:00100000:2.0:1789672915.920710:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714250368 00000100:00100000:2.0:1789672915.920713:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714250368 00000100:00100000:2.0:1789672915.920734:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 106 00000100:00100000:2.0:1789672915.920741:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714250240:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672915.925188:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2396:x1876607714249984:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 4732us (5162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672915.925848:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 386 00000100:00100000:1.0:1789672915.926008:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 304 00000100:00100000:1.0:1789672915.926103:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714250624:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672915.926175:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714250624:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 156us (5696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672915.926182:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 304 00000100:00080000:1.0:1789672915.929567:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789672915.929577:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789672915.929580:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672915.929607:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 107 00000100:00100000:1.0:1789672915.929625:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714250368:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672915.929723:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714250368:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 107us (9561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672915.932617:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714250112:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 12018us (12467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672915.932634:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 303 00000100:00100000:2.0:1789672915.932864:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714250240:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 12121us (12792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672915.932873:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 106 00000100:00100000:1.0:1789672915.935713:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 107 00000100:00100000:3.0:1789672915.976733:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672915.976814:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714250880 00000100:00100000:0.0:1789672915.976826:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714250880 00000100:00100000:0.0:1789672915.976889:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 98 00000100:00100000:0.0:1789672915.976900:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+23:10852:x1876607714250880:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789672915.976936:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672915.976958:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c99656fb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd250eb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.977074:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965702 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.977091:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99656e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250e4 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.977100:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965702 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.977171:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99656e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250e4 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.977206:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99656e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250e4 expref: 24 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672915.977221:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876607738452480:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789672915.977346:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4b95d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789672915.980817:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876607738452480:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789672915.980852:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965702 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672915.982548:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672915.982742:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714251008 00000100:00100000:2.0:1789672915.982750:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714251008 00010000:00010000:2.0:1789672915.982797:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99656e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250e4 expref: 25 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672915.982833:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:2.0:1789672915.982842:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:2395:x1876607714251008:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672915.982857:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672915.982864:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99656e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250e4 expref: 25 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672915.982893:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99656e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250e4 expref: 25 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672915.982913:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99656e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250e4 expref: 25 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672915.982940:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc61501300) 00010000:00010000:2.0:1789672915.982945:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965702 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672915.982954:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965702 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672915.982961:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965702 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672915.982991:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672915.983055:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+24:2395:x1876607714251008:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 213us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672915.983062:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 65 00010000:00010000:0.0:1789672915.983628:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965702 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.983638:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965702 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672915.983699:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789672915.983843:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c99656fb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250eb expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.983862:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965702 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250eb expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.983869:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc61501300) 00010000:00010000:0.0:1789672915.983872:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789672915.983875:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cd200, rc 0) 00000100:00100000:0.0:1789672915.983928:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+24:10852:x1876607714250880:12345-192.168.201.50@tcp:101:bash.0 Request processed in 7020us (7199us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1789672915.983949:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 98 00000100:00100000:3.0:1789672915.994598:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672915.995319:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714251136 00000100:00100000:1.0:1789672915.995330:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714251136 00000100:00100000:1.0:1789672915.995400:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 99 00000100:00100000:1.0:1789672915.995412:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+24:10852:x1876607714251136:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789672915.995437:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672915.995458:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965710 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd250f2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.995495:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965717 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.995509:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965717 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.995521:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965717 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.995654:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965710 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250f2 expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.995715:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965717 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250f2 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672915.995724:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc61501300) 00010000:00010000:1.0:1789672915.995727:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789672915.995731:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435000, rc 0) 00000100:00100000:1.0:1789672915.995799:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:10852:x1876607714251136:12345-192.168.201.50@tcp:101:bash.0 Request processed in 389us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672915.995813:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 99 00000100:00100000:3.0:1789672915.999079:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672915.999248:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714251392 00000100:00100000:0.0:1789672915.999258:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714251392 00000100:00100000:0.0:1789672915.999315:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 100 00000100:00100000:0.0:1789672915.999325:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:10852:x1876607714251392:12345-192.168.201.50@tcp:36:bash.0 00010000:00010000:0.0:1789672915.999535:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c996571e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.999553:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c996571e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.999564:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c996571e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672915.999603:0:11081:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1789672915.999624:0:11081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000612043f reply state 00000000c653b3ff transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c996571e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.999637:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c996571e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672915.999645:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc61501300) 00010000:00010000:0.0:1789672915.999647:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789672915.999652:0:11081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789672915.999766:0:11081:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1789672915.999891:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+29:10852:x1876607714251392:12345-192.168.201.50@tcp:36:bash.0 Request processed in 566us (819us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789672915.999898:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 100 00000020:00080000:0.0:1789672915.999903:0:11081:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789672916.002444:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672916.002525:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714251520 00000100:00100000:0.0:1789672916.002534:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714251520 00000100:00100000:0.0:1789672916.002605:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 101 00000100:00100000:0.0:1789672916.002622:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+29:10852:x1876607714251520:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789672916.002646:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672916.002689:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965725 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd250f9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.002744:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965725 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250f9 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.002760:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965725 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250f9 expref: 30 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.002789:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc61501300) 00010000:00010000:0.0:1789672916.002792:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789672916.002796:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cd800, rc 0) 00000100:00100000:0.0:1789672916.002854:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+30:10852:x1876607714251520:12345-192.168.201.50@tcp:101:bash.0 Request processed in 240us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672916.002861:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 101 00000100:00080000:1.0:1789672916.003454:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672916.010453:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672916.010774:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714251648 00000100:00100000:0.0:1789672916.010795:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714251648 00000100:00100000:0.0:1789672916.010877:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:0.0:1789672916.010888:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:10852:x1876607714251648:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789672916.010905:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672916.010934:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c996572c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25100 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789672916.010977:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aac3dd0, atime: 0x6aac3dcf, ctime: 0x6aac3dd0, blocks: 0x8 00010000:00010000:0.0:1789672916.010998:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1789672916.011003:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672916.011011:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c996572c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25100 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789672916.011160:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789672916.011270:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c996572c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25100 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.011284:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cd600, rc 0) 00000100:00100000:0.0:1789672916.011345:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:10852:x1876607714251648:12345-192.168.201.50@tcp:101:bash.0 Request processed in 459us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672916.011353:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:3.0:1789672916.017574:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672916.017740:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714251776 00000100:00100000:2.0:1789672916.017750:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714251776 00002000:00010000:2.0:1789672916.017799:0:8433:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1789672916.017804:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfb47b86d80 with x1876607714251776 ext(0->18446744073709551615) 00002000:00010000:2.0:1789672916.017815:0:8433:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfb47b86d80. 00000100:00100000:2.0:1789672916.017850:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:2.0:1789672916.017874:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2397:x1876607714251776:12345-192.168.201.50@tcp:10:bash.0 00002000:00010000:2.0:1789672916.018145:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789672916.018149:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789672912 -> 1789672914 00002000:00010000:2.0:1789672916.018152:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789672911 -> 1789672911 00002000:00010000:2.0:1789672916.018154:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789672912 -> 1789672914 00002000:00010000:2.0:1789672916.018155:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789672916.018214:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2397:x1876607714251776:12345-192.168.201.50@tcp:10:bash.0 Request processed in 342us (650us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789672916.018221:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 1 00002000:00010000:2.0:1789672916.018224:0:8433:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1789672916.018227:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfb47b86d80 with x1876607714251776 ext(0->18446744073709551615) 00002000:00010000:2.0:1789672916.018231:0:8433:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfb47b86d80. 00000100:00100000:3.0:1789672916.129133:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672916.129302:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714251904 00000100:00100000:0.0:1789672916.129312:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714251904 00000100:00100000:0.0:1789672916.129379:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 102 00000100:00100000:0.0:1789672916.129391:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+30:11341:x1876607714251904:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:0.0:1789672916.129464:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965733 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129481:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965733 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129495:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965733 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129532:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996573a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129540:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996573a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129548:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996573a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129650:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965741 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129707:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129716:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789672916.129760:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129773:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965733 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129791:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965733 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129799:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965733 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129805:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8ccc00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672916.129809:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965733 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129825:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965733 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129838:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:0.0:1789672916.129842:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672916.129848:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965733 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129854:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965733 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129868:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996573a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129875:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996573a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129881:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996573a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129886:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cda00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672916.129889:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996573a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129895:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996573a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.129902:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfb478f1c00) 00010000:00010000:0.0:1789672916.129905:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672916.129908:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996573a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.130172:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996573a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.130187:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.130192:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965741 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.130197:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965741 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.130202:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672916.130205:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965741 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.130210:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965741 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.130218:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc61501300) 00010000:00010000:0.0:1789672916.130220:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672916.130223:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965741 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.130229:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965741 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672916.130401:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+30:11341:x1876607714251904:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 1011us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672916.130408:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 102 00010000:00010000:0.0:1789672916.168889:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672916.226843:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672916.226955:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714252160 00000100:00100000:0.0:1789672916.226966:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714252160 00000100:00100000:0.0:1789672916.227030:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 103 00000100:00100000:0.0:1789672916.227040:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+30:11344:x1876607714252160:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789672916.227060:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672916.227081:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965748 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25107 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227157:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996574f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227172:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996574f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227185:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996574f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227359:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965756 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227369:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965756 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227375:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965756 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227482:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996575d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227492:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996575d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227517:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996575d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672916.227529:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789672916.227603:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996574f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227609:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996574f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227616:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996574f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227622:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cda00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672916.227627:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996574f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227634:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996574f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227646:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:0.0:1789672916.227650:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672916.227655:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996574f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227702:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996574f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227716:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965756 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227721:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965756 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227733:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965756 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227737:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8ccc00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672916.227739:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965756 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227745:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965756 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227753:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfb478f1c00) 00010000:00010000:0.0:1789672916.227756:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672916.227759:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965756 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.227764:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965756 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.228035:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965748 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25107 expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.228050:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996575d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25107 expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.228057:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc61501300) 00010000:00010000:0.0:1789672916.228059:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789672916.228062:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cc000, rc 0) 00000100:00100000:2.0:1789672916.228334:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+32:11344:x1876607714252160:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 1294us (1497us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789672916.228342:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 103 00000100:00100000:2.0:1789672916.237799:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672916.237944:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714252288 00000100:00100000:1.0:1789672916.237954:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714252288 00000100:00100000:1.0:1789672916.238013:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 104 00000100:00100000:1.0:1789672916.238023:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+32:11344:x1876607714252288:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:1.0:1789672916.238092:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996576b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.238109:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965702 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250eb expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.238119:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996576b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.238152:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965702 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250eb expref: 32 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.238165:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965702 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250eb expref: 32 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672916.238178:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47986300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738452608:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672916.238278:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bba6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672916.240514:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47986300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738452608:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672916.240542:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996576b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672916.242424:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672916.242692:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714252544 00000100:00100000:3.0:1789672916.242703:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714252544 00000100:00100000:3.0:1789672916.242769:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:3.0:1789672916.242790:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+33:6169:x1876607714252544:12345-192.168.201.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789672916.243089:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+34:6169:x1876607714252544:12345-192.168.201.50@tcp:35:ldlm_bl.0 Request processed in 310us (673us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789672916.243097:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:3.0:1789672916.274618:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672916.274933:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714252672 00000100:00100000:1.0:1789672916.274944:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714252672 00010000:00010000:1.0:1789672916.274986:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965702 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250eb expref: 34 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672916.275031:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:1.0:1789672916.275042:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+34:2395:x1876607714252672:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672916.275056:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672916.275063:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965702 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250eb expref: 34 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.275076:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965702 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250eb expref: 34 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.275099:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965702 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250eb expref: 34 pid: 6513 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.275116:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc61501300) 00010000:00010000:1.0:1789672916.275120:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996576b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.275130:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996576b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.275137:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996576b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.275171:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672916.275242:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+33:2395:x1876607714252672:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 201us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672916.275250:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 66 00010000:00010000:2.0:1789672916.275413:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996576b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.275422:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996576b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.275465:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996576b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.275472:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996576b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.275489:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996576b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.275495:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672916.275500:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996576b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.275507:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996576b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.275517:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc61501300) 00010000:00010000:2.0:1789672916.275520:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789672916.275523:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996576b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.275529:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996576b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672916.275568:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+32:11344:x1876607714252288:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 37546us (37779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672916.275576:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 104 00000100:00100000:2.0:1789672916.282403:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672916.282498:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714252928 00000100:00100000:3.0:1789672916.282508:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714252928 00000100:00100000:3.0:1789672916.282565:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:3.0:1789672916.282576:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+32:11344:x1876607714252928:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789672916.282868:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+33:11344:x1876607714252928:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 293us (474us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789672916.282876:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:3.0:1789672916.456651:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672916.456826:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714253184 00000100:00100000:1.0:1789672916.456837:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714253184 00000100:00100000:1.0:1789672916.456897:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 105 00000100:00100000:1.0:1789672916.456909:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+33:11355:x1876607714253184:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:1.0:1789672916.456943:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672916.456965:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965772 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2510e expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457036:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965779 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457051:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965779 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457064:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965779 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457079:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c9965780 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457086:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c9965780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457093:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c9965780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457201:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965787 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457228:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457236:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672916.457246:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789672916.457319:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965779 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457327:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965779 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457334:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965779 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457339:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672916.457343:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965779 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457351:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965779 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457363:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:1.0:1789672916.457366:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672916.457370:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965779 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457376:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965779 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457389:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c9965780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457402:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c9965780 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457407:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c9965780 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457412:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672916.457414:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c9965780 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457420:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c9965780 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457428:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfc61501700) 00010000:00010000:1.0:1789672916.457430:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672916.457432:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c9965780 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457438:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c9965780 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457480:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965772 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2510e expref: 36 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457494:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2510e expref: 35 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.457502:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc61501300) 00010000:00010000:1.0:1789672916.457504:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672916.457513:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434a00, rc 0) 00000100:00100000:1.0:1789672916.457836:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+35:11355:x1876607714253184:12345-192.168.201.50@tcp:101:cat.0 Request processed in 928us (1193us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789672916.457843:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 105 00000100:00100000:2.0:1789672916.464163:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672916.464261:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714253440 00000100:00100000:3.0:1789672916.464272:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714253440 00000100:00100000:3.0:1789672916.464334:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:3.0:1789672916.464343:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+35:11355:x1876607714253440:12345-192.168.201.50@tcp:35:cat.0 00000100:00100000:3.0:1789672916.464623:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+36:11355:x1876607714253440:12345-192.168.201.50@tcp:35:cat.0 Request processed in 279us (469us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789672916.464631:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:2.0:1789672916.500325:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672916.500570:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714253696 00000100:00100000:3.0:1789672916.500581:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714253696 00000100:00100000:3.0:1789672916.500641:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 106 00000100:00100000:3.0:1789672916.500652:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+36:11356:x1876607714253696:12345-192.168.201.50@tcp:36:rm.0 00010000:00010000:3.0:1789672916.500758:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789672916.500797:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965725 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250f9 expref: 36 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.500820:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965787 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2510e expref: 35 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.500854:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c996575d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25107 expref: 34 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.500865:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965717 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250f2 expref: 33 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.500874:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc61501300) 00010000:00010000:3.0:1789672916.500879:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672916.500901:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965795 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.500925:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965795 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.500935:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965795 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.500949:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c996579c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.500956:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c996579c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.500962:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c996579c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501034:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99657a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501042:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99657a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501056:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99657a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789672916.501292:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1789672916.501303:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394416644199ns, next at 395416641132ns, rc = 0 00010000:00010000:3.0:1789672916.501347:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c99657aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501356:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c99657aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501364:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c99657aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501370:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c99657aa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501376:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c99657aa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501381:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c99657aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501394:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789672916.501412:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99657a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501418:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99657a3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501424:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99657a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501437:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672916.501442:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99657a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501449:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99657a3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501459:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc61501300) 00010000:00010000:3.0:1789672916.501462:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789672916.501466:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99657a3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501472:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99657a3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501488:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965795 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501494:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965795 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501500:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965795 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501505:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672916.501508:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965795 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501513:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965795 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501531:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:3.0:1789672916.501533:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672916.501536:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965795 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501542:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965795 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672916.501552:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecbba3e5 reply state 00000000879be5cb transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c996579c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501562:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c996579c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.501568:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfb419b0d00) 00010000:00010000:3.0:1789672916.501570:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789672916.501572:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789672916.501805:0:13186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672916.501812:0:13186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c99657aa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.501826:0:13186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887a00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789672916.501830:0:13186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c99657aa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.501836:0:13186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c99657aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.501846:0:13186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc61501300) 00010000:00010000:0.0:1789672916.501848:0:13186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789672916.501851:0:13186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c99657aa lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.501857:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c99657aa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.501867:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672916.501869:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672916.501870:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672916.502017:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+34:11356:x1876607714253696:12345-192.168.201.50@tcp:36:rm.0 Request processed in 1365us (1701us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789672916.502026:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 106 00000100:00100000:2.0:1789672916.630137:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672916.630232:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714253952 00000100:00100000:1.0:1789672916.630243:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714253952 00000100:00100000:1.0:1789672916.630319:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 107 00000100:00100000:1.0:1789672916.630331:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+34:11362:x1876607714253952:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789672916.630356:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672916.630376:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c99657b1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25115 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.630508:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99657b8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.630524:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99657b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.630536:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99657b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.630546:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c99657bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.630553:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c99657bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.630559:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c99657bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789672916.630920:0:6514:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789672916.631069:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99657c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.631078:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99657c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.631086:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99657c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.631118:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99657b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.631126:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99657b8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.631133:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99657b8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.631139:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672916.631143:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99657b8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.631151:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99657b8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.631164:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:1.0:1789672916.631168:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672916.631174:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99657b8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.631180:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99657b8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789672916.631205:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8db4644 reply state 00000000298f03b9 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c99657bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.631217:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c99657bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.631223:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfb419b0d00) 00010000:00010000:1.0:1789672916.631225:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789672916.631228:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789672916.631258:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c99657b1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25115 expref: 37 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.631271:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99657c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25115 expref: 36 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.631278:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc61501700) 00010000:00010000:1.0:1789672916.631280:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672916.631282:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434200, rc 0) 00000100:00100000:1.0:1789672916.631359:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+37:11362:x1876607714253952:12345-192.168.201.50@tcp:101:bash.0 Request processed in 1024us (1227us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789672916.631367:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 107 00000100:00100000:1.0:1789672916.636646:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672916.639432:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714254080 00000100:00100000:2.0:1789672916.639450:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714254080 00000100:00100000:2.0:1789672916.639533:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:2.0:1789672916.639545:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2398:x1876607714254080:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789672916.639591:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672916.639619:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0039243/0x6c78c4f8c99657d4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2511c expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789672916.639650:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789672916.639700:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1789672916.639706:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672916.639723:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0039243/0x6c78c4f8c99657d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2511c expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.639743:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c0039243/0x6c78c4f8c99657d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2511c expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.639757:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee600, rc 0) 00000100:00100000:2.0:1789672916.639838:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2398:x1876607714254080:12345-192.168.201.50@tcp:101:bash.0 Request processed in 294us (3202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672916.639845:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:2.0:1789672916.645334:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672916.645414:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714254208 00000100:00100000:3.0:1789672916.645425:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714254208 00000100:00100000:3.0:1789672916.645489:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:3.0:1789672916.645500:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:11362:x1876607714254208:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789672916.645529:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672916.645547:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25123 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.645579:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0039243/0x6c78c4f8c99657d4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2511c expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.645601:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672916.645606:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672916.645612:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25123 expref: 9 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.645645:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0039243/0x6c78c4f8c99657d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2511c expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.645980:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0039243/0x6c78c4f8c99657d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2511c expref: 9 pid: 8429 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672916.645998:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47b86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8428:1876607738452736:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672916.646149:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789672916.652241:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47b86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8428:1876607738452736:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789672916.652286:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25123 expref: 9 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672916.652308:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886000, rc 0) 00000100:00100000:3.0:1789672916.652383:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:11362:x1876607714254208:12345-192.168.201.50@tcp:101:bash.0 Request processed in 6884us (7059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672916.652393:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:1.0:1789672916.656056:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672916.656646:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714254336 00000100:00100000:2.0:1789672916.656689:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714254336 00010000:00010000:2.0:1789672916.656814:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0039243/0x6c78c4f8c99657d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2511c expref: 9 pid: 8429 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672916.656899:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:2.0:1789672916.656920:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47984380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2395:x1876607714254336:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672916.656934:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672916.656973:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0039243/0x6c78c4f8c99657d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2511c expref: 9 pid: 8429 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.656988:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0039243/0x6c78c4f8c99657d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2511c expref: 9 pid: 8429 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.657012:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0039243/0x6c78c4f8c99657d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2511c expref: 9 pid: 8429 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.657029:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672916.657034:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672916.657042:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25123 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.657053:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25123 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.657093:0:7920:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25123 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672916.657108:0:7920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47b83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7920:1876607738452864:192.168.201.50@tcp:105: 00000100:00100000:2.0:1789672916.657216:0:7920:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672916.661053:0:7920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47b83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7920:1876607738452864:192.168.201.50@tcp:105: 00010000:00010000:0.0:1789672916.661098:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672916.661163:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47984380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2395:x1876607714254336:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 4255us (5115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672916.661174:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:3.0:1789672916.672607:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672916.673379:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714254592 00000100:00100000:2.0:1789672916.673391:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714254592 00000100:00100000:2.0:1789672916.673497:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:2.0:1789672916.676801:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+37:11362:x1876607714254592:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:2.0:1789672916.677483:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+38:11362:x1876607714254592:12345-192.168.201.50@tcp:35:bash.0 Request processed in 3973us (4883us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789672916.677494:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:2.0:1789672916.805120:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738452992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789672916.805350:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672916.805590:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738452992 00000100:00100000:0.0:1789672916.805599:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738452992 00000100:00100000:0.0:1789672916.805651:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789672916.805682:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738452992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789672916.805791:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789672916.805859:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738452992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 179us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672916.805866:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789672916.806112:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738452992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789672916.877783:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672916.878057:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714254720 00000100:00100000:0.0:1789672916.878069:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714254720 00000100:00100000:0.0:1789672916.878140:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 108 00000100:00100000:0.0:1789672916.878150:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+38:11378:x1876607714254720:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789672916.878177:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672916.878211:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c99657e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2512a expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.878290:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99657e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.878306:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99657e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.878318:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99657e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672916.878365:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789672916.878371:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789672916.878391:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99657e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.878419:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c99657e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2512a expref: 40 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.878439:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99657e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2512a expref: 39 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.878469:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:0.0:1789672916.878472:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789672916.878476:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8ccc00, rc 0) 00000100:00100000:0.0:1789672916.878547:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+39:11378:x1876607714254720:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 398us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672916.878554:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 108 00000100:00100000:3.0:1789672916.884275:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672916.884488:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714254976 00000100:00100000:2.0:1789672916.884500:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714254976 00000100:00100000:2.0:1789672916.884564:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 109 00000100:00100000:2.0:1789672916.884575:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+39:11378:x1876607714254976:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789672916.884600:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672916.884622:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99657f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25131 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.884793:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c99657f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.884807:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c99657f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.884819:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c99657f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672916.884831:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789672916.885123:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99657f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25131 expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.885166:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c99657f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25131 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.885174:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc61501700) 00010000:00010000:2.0:1789672916.885177:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672916.885181:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee800, rc 0) 00000100:00100000:2.0:1789672916.885258:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+41:11378:x1876607714254976:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 685us (993us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1789672916.885266:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 109 00000100:00100000:3.0:1789672916.894377:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672916.894439:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672916.894544:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714255360 00000100:00100000:0.0:1789672916.894556:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714255360 00000100:00100000:0.0:1789672916.894633:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:0.0:1789672916.894646:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+41:2395:x1876607714255360:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672916.894704:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672916.894849:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c99657f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25131 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.894869:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc61501700) 00010000:00010000:0.0:1789672916.894875:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672916.895121:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+40:2395:x1876607714255360:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 476us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672916.895131:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:1.0:1789672916.895417:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714255232 00000100:00100000:1.0:1789672916.895423:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714255232 00000100:00100000:1.0:1789672916.895465:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 110 00000100:00100000:1.0:1789672916.895473:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+40:11378:x1876607714255232:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789672916.895512:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672916.895531:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965805 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25138 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.895647:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c996580c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.895692:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c996580c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.895705:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c996580c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672916.895730:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789672916.895860:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965805 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25138 expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.895878:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c996580c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25138 expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.895885:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc61501700) 00010000:00010000:1.0:1789672916.895888:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789672916.895891:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435800, rc 0) 00000100:00100000:1.0:1789672916.896125:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+42:11378:x1876607714255232:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 651us (1760us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1789672916.896133:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 110 00000100:00100000:2.0:1789672916.906243:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672916.906340:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714255488 00000100:00100000:0.0:1789672916.906355:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714255488 00000100:00100000:0.0:1789672916.906423:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:0.0:1789672916.906434:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2396:x1876607714255488:12345-192.168.201.50@tcp:1:lfs.0 00010000:00010000:0.0:1789672916.906484:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d01d88/0x6c78c4f8c996581a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.906530:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25123 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.906538:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672916.906543:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789672916.906547:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073d01d88/0x6c78c4f8c996581a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.906590:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25123 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.906605:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25123 expref: 8 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672916.906619:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8429:1876607738453120:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789672916.906780:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc44cc1000 going to sleep for 11 seconds 00000100:00100000:0.0:1789672916.910573:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8429:1876607738453120:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789672916.910608:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073d01d88/0x6c78c4f8c996581a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672916.911578:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672916.911688:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714255616 00000100:00100000:1.0:1789672916.911698:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714255616 00002000:00100000:1.0:1789672916.911759:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8cfb47b82680 x1876607714255616/t0(0) o4->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:542/0 lens 504/0 e 0 to 0 dl 1789672927 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789672916.911913:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfb47b82680 with x1876607714255616 ext(0->8) 00010000:00010000:1.0:1789672916.911925:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25123 expref: 9 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.912110:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25123 expref: 9 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789672916.912120:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cfb47b82680 00000100:00100000:1.0:1789672916.912153:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:1.0:1789672916.912164:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2396:x1876607714255616:12345-192.168.201.50@tcp:4:lfs.0 00000100:00100000:1.0:1789672916.913463:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+11:2396:x1876607714255616:12345-192.168.201.50@tcp:4:lfs.0 Request processed in 1293us (1880us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789672916.913475:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 1 00002000:00100000:1.0:1789672916.913486:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8cfb47b82680 x1876607714255616/t4294967303(0) o4->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:542/0 lens 504/448 e 0 to 0 dl 1789672927 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789672916.913495:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfb47b82680 with x1876607714255616 ext(0->8) 00010000:00010000:1.0:1789672916.913505:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25123 expref: 11 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.913520:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25123 expref: 11 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789672916.913528:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cfb47b82680 00000100:00100000:2.0:1789672916.917573:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672916.917800:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714255744 00000100:00100000:1.0:1789672916.917829:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714255744 00010000:00010000:0.0:1789672916.918065:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25123 expref: 11 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672916.918147:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:0.0:1789672916.918166:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc65c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+11:2395:x1876607714255744:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672916.918182:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789672916.918215:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789672916.918218:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789672915 00002000:00010000:0.0:1789672916.918220:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789672915 00002000:00010000:0.0:1789672916.918222:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789672915 00002000:00010000:0.0:1789672916.918224:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789672916.918232:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25123 expref: 11 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.918247:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25123 expref: 11 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.918273:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99657db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25123 expref: 11 pid: 8428 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.918291:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789672916.918295:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789672916.918301:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073d01d88/0x6c78c4f8c996581a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.918310:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073d01d88/0x6c78c4f8c996581a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.918348:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672916.918408:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc65c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+10:2395:x1876607714255744:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 244us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672916.918425:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 68 00010000:00010000:1.0:1789672916.918511:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073d01d88/0x6c78c4f8c996581a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.918521:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073d01d88/0x6c78c4f8c996581a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.918540:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073d01d88/0x6c78c4f8c996581a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.918548:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073d01d88/0x6c78c4f8c996581a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.918556:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073d01d88/0x6c78c4f8c996581a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.918563:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc800 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789672916.918567:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d01d88/0x6c78c4f8c996581a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.918574:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073d01d88/0x6c78c4f8c996581a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.918586:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073d01d88/0x6c78c4f8c996581a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.918593:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073d01d88/0x6c78c4f8c996581a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672916.918648:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2396:x1876607714255488:12345-192.168.201.50@tcp:1:lfs.0 Request processed in 12218us (12416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672916.918692:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:3.0:1789672916.922223:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672916.922393:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714256000 00000100:00100000:1.0:1789672916.922403:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714256000 00000100:00100000:1.0:1789672916.922468:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:1.0:1789672916.922479:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f853c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+42:11378:x1876607714256000:12345-192.168.201.50@tcp:35:lfs.0 00000004:00010000:1.0:1789672916.922544:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c996580c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25138 expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789672916.922835:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1789672916.922871:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1789672916.923698:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1789672916.924534:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965821 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.924559:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99657c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25115 expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.924568:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965821 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.924617:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99657c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25115 expref: 46 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.924635:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99657c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25115 expref: 46 pid: 6514 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672916.924925:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47985c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1876607738453248:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789672916.925147:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672916.928812:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672916.928935:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47985c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1876607738453248:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789672916.928972:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965821 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672916.929140:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714256128 00000100:00100000:1.0:1789672916.929149:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714256128 00010000:00010000:1.0:1789672916.929186:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99657c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25115 expref: 47 pid: 6514 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672916.929225:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:1.0:1789672916.929235:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+47:2396:x1876607714256128:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672916.929250:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672916.929257:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99657c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25115 expref: 47 pid: 6514 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.929268:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99657c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25115 expref: 47 pid: 6514 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.929290:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99657c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25115 expref: 47 pid: 6514 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.929304:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc61501700) 00010000:00010000:1.0:1789672916.929309:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965821 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.929318:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965821 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.929325:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965821 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.929368:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672916.929425:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+46:2396:x1876607714256128:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 191us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672916.929433:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 69 00010000:00010000:0.0:1789672916.929584:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965821 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672916.929592:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965821 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672916.929751:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1789672916.929886:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1789672916.930163:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876607738453376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789672916.930223:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672916.930264:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc41254cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672916.930337:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738453376 00000100:00100000:3.0:1789672916.930344:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738453376 00000100:00100000:3.0:1789672916.930399:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789672916.930408:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6516:x1876607738453376:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789672916.930491:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6516:x1876607738453376:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672916.930498:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:1.0:1789672916.930573:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789672916.931244:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876607738453376:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789672916.931389:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1789672916.931452:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876607738453504:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789672916.931496:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672916.931525:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb46884cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672916.931594:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738453504 00000100:00100000:3.0:1789672916.931601:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738453504 00000100:00100000:3.0:1789672916.931640:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789672916.931649:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6516:x1876607738453504:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789672916.931820:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6516:x1876607738453504:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 172us (322us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789672916.931828:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789672916.931983:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876607738453504:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789672916.932026:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789672916.932063:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965821 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.932073:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965821 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.932081:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965821 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.932087:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434e00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672916.932091:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965821 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.932100:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965821 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.932118:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc61501700) 00010000:00010000:1.0:1789672916.932121:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789672916.932127:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965821 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672916.932133:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c9965821 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789672916.932245:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789672916.932307:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1789672916.932318:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394847658536ns, next at 395847656059ns, rc = 0 00000001:00080000:1.0:1789672916.932324:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1789672916.932346:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc61501700) 00010000:00010000:1.0:1789672916.932349:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789672916.932356:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c996580c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25138 expref: 50 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672916.932445:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f853c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+49:11378:x1876607714256000:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 9969us (10234us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789672916.932453:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 26 00000020:00080000:1.0:1789672916.932457:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789672916.936728:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672916.936901:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714256256 00000100:00100000:2.0:1789672916.936925:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714256256 00000100:00100000:2.0:1789672916.937116:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 111 00000100:00100000:2.0:1789672916.937127:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+49:11378:x1876607714256256:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789672916.937155:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672916.937177:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965828 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2513f expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.937243:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965828 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2513f expref: 50 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.937259:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965828 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2513f expref: 50 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672916.937300:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:2.0:1789672916.937303:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789672916.937307:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee200, rc 0) 00000100:00100000:2.0:1789672916.937371:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+50:11378:x1876607714256256:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 245us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672916.937378:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 111 00000100:00100000:2.0:1789672916.941038:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672916.941582:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714256512 00000100:00100000:3.0:1789672916.941602:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714256512 00000100:00100000:3.0:1789672916.941691:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:3.0:1789672916.941702:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+50:11378:x1876607714256512:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789672916.942065:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+51:11378:x1876607714256512:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 365us (1036us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789672916.942074:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:0.0:1789672917.058922:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672917.059453:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714256640 00000100:00100000:3.0:1789672917.059483:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714256640 00000100:00100000:3.0:1789672917.059607:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 112 00000100:00100000:3.0:1789672917.059618:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+51:11388:x1876607714256640:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:3.0:1789672917.059819:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996582f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.059837:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996582f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.059849:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996582f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.059860:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965836 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.059868:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.059875:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060069:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c996583d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060078:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c996583d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060085:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c996583d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672917.060140:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c996583d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060164:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996582f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060170:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996582f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060177:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996582f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060183:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672917.060187:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996582f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060597:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996582f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060610:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:3.0:1789672917.060613:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672917.060618:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996582f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060625:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996582f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060640:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060646:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965836 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060652:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965836 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060802:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672917.060806:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965836 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060811:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965836 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060819:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfb419b0d00) 00010000:00010000:3.0:1789672917.060822:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672917.060825:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965836 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060832:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965836 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060841:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c996583d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060847:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c996583d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060852:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c996583d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060857:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672917.060860:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c996583d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060865:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c996583d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060885:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:3.0:1789672917.060888:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672917.060891:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c996583d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.060896:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c996583d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672917.061063:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+51:11388:x1876607714256640:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 1444us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672917.061072:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 112 00000100:00100000:2.0:1789672917.110590:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672917.110802:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714256896 00000100:00100000:3.0:1789672917.110813:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714256896 00000100:00100000:3.0:1789672917.110880:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 113 00000100:00100000:3.0:1789672917.110892:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+51:11391:x1876607714256896:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789672917.111084:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672917.111110:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965844 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25146 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111184:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996584b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111355:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996584b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111370:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996584b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111384:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965852 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111407:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965852 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111414:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965852 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111528:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965859 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111536:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111543:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672917.111553:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789672917.111631:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996584b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111638:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996584b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111645:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996584b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111651:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672917.111655:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996584b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111709:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996584b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111731:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:3.0:1789672917.111734:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672917.111740:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996584b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111745:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996584b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111769:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965852 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111775:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965852 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111780:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965852 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111784:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672917.111787:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965852 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111792:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965852 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111799:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfb419b0d00) 00010000:00010000:3.0:1789672917.111801:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672917.111804:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965852 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111809:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965852 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111855:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965844 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25146 expref: 54 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111870:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965859 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25146 expref: 53 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.111877:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:3.0:1789672917.111879:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672917.111882:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886200, rc 0) 00000100:00100000:3.0:1789672917.112135:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+53:11391:x1876607714256896:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 1244us (1555us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789672917.112143:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 113 00000100:00100000:2.0:1789672917.116490:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672917.116578:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714257024 00000100:00100000:3.0:1789672917.116589:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714257024 00000100:00100000:3.0:1789672917.116649:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 114 00000100:00100000:3.0:1789672917.116694:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+53:11391:x1876607714257024:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:3.0:1789672917.116786:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965867 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.116803:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965867 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.116815:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965867 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.116852:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965867 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.116880:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965867 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.116886:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965867 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.116892:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672917.116897:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965867 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.116914:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965867 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.116927:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:3.0:1789672917.116930:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789672917.116943:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965867 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.116949:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965867 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672917.117030:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+53:11391:x1876607714257024:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 373us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672917.117038:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 114 00000100:00100000:0.0:1789672917.120423:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672917.120507:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714257280 00000100:00100000:3.0:1789672917.120518:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714257280 00000100:00100000:3.0:1789672917.120577:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:3.0:1789672917.120587:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+53:11391:x1876607714257280:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789672917.120882:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+54:11391:x1876607714257280:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 294us (468us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1789672917.120897:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 28 00010000:00010000:2.0:1789672917.188502:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672917.217548:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672917.217831:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714257536 00000100:00100000:3.0:1789672917.217842:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714257536 00000100:00100000:3.0:1789672917.218048:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 115 00000100:00100000:3.0:1789672917.218059:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+54:11401:x1876607714257536:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789672917.218085:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672917.218089:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789672917.218115:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c99657e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2512a expref: 54 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.218135:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:3.0:1789672917.218140:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672917.218154:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996586e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2514d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.218598:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965875 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.218614:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965859 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25146 expref: 54 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.218622:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965875 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.218652:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965859 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25146 expref: 54 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.218757:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965859 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25146 expref: 54 pid: 9524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672917.218815:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47b84e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876607738453632:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672917.218926:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805000 going to sleep for 11 seconds 00000100:00100000:2.0:1789672917.222461:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672917.222569:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47b84e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876607738453632:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789672917.222597:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965875 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672917.222876:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714257664 00000100:00100000:1.0:1789672917.222885:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714257664 00010000:00010000:1.0:1789672917.222941:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965859 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25146 expref: 55 pid: 9524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672917.222980:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 70 00000100:00100000:1.0:1789672917.222990:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+55:2396:x1876607714257664:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672917.223003:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672917.223010:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965859 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25146 expref: 55 pid: 9524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.223023:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965859 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25146 expref: 55 pid: 9524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.223062:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965859 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25146 expref: 55 pid: 9524 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.223077:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:1.0:1789672917.223081:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965875 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.223090:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965875 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.223098:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965875 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.223128:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672917.223178:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+54:2396:x1876607714257664:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 189us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672917.223185:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 70 00010000:00010000:2.0:1789672917.223500:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965875 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.223509:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965875 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672917.223528:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789672917.223699:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c996586e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2514d expref: 55 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.223716:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965875 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2514d expref: 54 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.223723:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:2.0:1789672917.223726:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789672917.223737:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887a00, rc 0) 00000100:00100000:2.0:1789672917.223778:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+54:11401:x1876607714257536:12345-192.168.201.50@tcp:101:bash.0 Request processed in 5721us (6242us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789672917.223785:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 115 00000100:00100000:2.0:1789672917.227736:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672917.227800:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714257792 00000100:00100000:3.0:1789672917.227811:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714257792 00000100:00100000:3.0:1789672917.227884:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 116 00000100:00100000:3.0:1789672917.227895:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+54:11401:x1876607714257792:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789672917.227920:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672917.227940:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965883 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25154 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.227974:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996588a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.227989:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996588a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.228001:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996588a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.228125:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965883 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25154 expref: 56 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.228145:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996588a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25154 expref: 55 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.228160:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:3.0:1789672917.228163:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789672917.228166:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886c00, rc 0) 00000100:00100000:3.0:1789672917.228239:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+55:11401:x1876607714257792:12345-192.168.201.50@tcp:101:bash.0 Request processed in 346us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672917.228246:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 116 00000100:00100000:1.0:1789672917.231689:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672917.232535:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714258048 00000100:00100000:2.0:1789672917.232548:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714258048 00000100:00100000:2.0:1789672917.232688:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 117 00000100:00100000:2.0:1789672917.232700:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+55:11401:x1876607714258048:12345-192.168.201.50@tcp:36:bash.0 00010000:00010000:2.0:1789672917.233122:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965891 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.233140:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.233151:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789672917.233194:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1789672917.233219:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a730771 reply state 000000003fc22c20 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.233231:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965891 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.233238:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:2.0:1789672917.233240:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789672917.233244:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789672917.233382:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:11401:x1876607714258048:12345-192.168.201.50@tcp:36:bash.0 Request processed in 683us (1726us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789672917.233390:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 117 00000020:00080000:2.0:1789672917.233409:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789672917.236497:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672917.236595:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714258176 00000100:00100000:2.0:1789672917.236605:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714258176 00000100:00100000:2.0:1789672917.236735:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 118 00000100:00100000:2.0:1789672917.236746:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:11401:x1876607714258176:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789672917.236779:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672917.236800:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c9965898 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2515b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.236928:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.237009:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965875 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2514d expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.237019:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.237053:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965875 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2514d expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.237067:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965875 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2514d expref: 59 pid: 6513 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672917.237080:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47b80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876607738453760:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789672917.237160:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672917.239559:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47b80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876607738453760:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789672917.239587:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672917.241388:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672917.241481:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714258304 00000100:00100000:0.0:1789672917.241491:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714258304 00010000:00010000:0.0:1789672917.241531:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965875 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2514d expref: 60 pid: 6513 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672917.241574:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:0.0:1789672917.241584:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47987480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:2395:x1876607714258304:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672917.241598:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672917.241605:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965875 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2514d expref: 60 pid: 6513 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672917.241618:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965875 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2514d expref: 60 pid: 6513 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672917.241640:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965875 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2514d expref: 60 pid: 6513 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672917.241691:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:0.0:1789672917.241697:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672917.241715:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672917.241722:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672917.241752:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672917.241825:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47987480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+59:2395:x1876607714258304:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 242us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672917.241833:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 71 00010000:00010000:2.0:1789672917.242539:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.242550:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672917.242610:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789672917.242616:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789672917.242639:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.242702:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c9965898 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2515b expref: 59 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.242731:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2515b expref: 58 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.242739:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:2.0:1789672917.242742:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672917.242744:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aeec00, rc 0) 00000100:00100000:2.0:1789672917.242797:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:11401:x1876607714258176:12345-192.168.201.50@tcp:101:bash.0 Request processed in 6053us (6309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672917.242805:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 118 00000100:00100000:1.0:1789672917.247269:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672917.247421:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714258560 00000100:00100000:3.0:1789672917.247432:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714258560 00000100:00100000:3.0:1789672917.247491:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:3.0:1789672917.247501:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:11401:x1876607714258560:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:3.0:1789672917.247776:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+59:11401:x1876607714258560:12345-192.168.201.50@tcp:35:bash.0 Request processed in 276us (516us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1789672917.247784:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:0.0:1789672917.353067:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672917.353182:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714258688 00000100:00100000:2.0:1789672917.353202:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714258688 00000100:00100000:2.0:1789672917.353266:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 119 00000100:00100000:2.0:1789672917.353275:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+59:11407:x1876607714258688:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789672917.353300:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672917.353320:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c99658a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25162 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.353406:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee400/0x6c78c4f8c99658ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.353436:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee400/0x6c78c4f8c99658ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.353447:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee400/0x6c78c4f8c99658ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672917.353490:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789672917.353494:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789672917.353512:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee400/0x6c78c4f8c99658ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.353535:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c99658a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25162 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.353552:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee400/0x6c78c4f8c99658ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25162 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.353559:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:2.0:1789672917.353562:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789672917.353577:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee400, rc 0) 00000100:00100000:2.0:1789672917.353639:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:11407:x1876607714258688:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 364us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672917.353646:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 119 00000100:00100000:0.0:1789672917.361331:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672917.361590:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714258816 00000100:00100000:2.0:1789672917.361604:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714258816 00000100:00100000:2.0:1789672917.361739:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00100000:2.0:1789672917.361750:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:11407:x1876607714258816:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789672917.361783:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672917.361824:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c99658b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25169 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.361892:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99658bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.361909:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99658bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.361921:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99658bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.361944:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99658c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.361953:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99658c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.361959:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99658c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362046:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99658c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362056:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99658c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362063:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99658c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672917.362105:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789672917.362110:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789672917.362129:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99658c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362149:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99658c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362158:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99658bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362165:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99658bb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362172:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99658bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362179:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aef800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672917.362183:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99658bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362202:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99658bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362214:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:2.0:1789672917.362218:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672917.362222:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99658bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362229:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99658bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362243:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99658c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362249:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99658c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362262:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99658c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362267:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aeea00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672917.362271:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99658c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362277:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99658c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362286:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfb419b0d00) 00010000:00010000:2.0:1789672917.362289:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672917.362292:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99658c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362298:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99658c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362329:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c99658b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25169 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362354:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99658c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25169 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.362361:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:2.0:1789672917.362363:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672917.362366:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aeee00, rc 0) 00000100:00100000:2.0:1789672917.362436:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:11407:x1876607714258816:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 688us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672917.362452:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00100000:1.0:1789672917.366766:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672917.366902:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714259072 00000100:00100000:2.0:1789672917.366912:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714259072 00000100:00100000:2.0:1789672917.367105:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 121 00000100:00100000:2.0:1789672917.367116:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:11407:x1876607714259072:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789672917.367136:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672917.367158:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c99658d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25170 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.367269:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.367285:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2515b expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.367293:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99658c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25169 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.367300:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.367332:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99658c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25169 expref: 62 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.367346:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99658c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25169 expref: 62 pid: 6514 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672917.367358:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47b83480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876607738453888:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789672917.367545:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2515b expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672917.367554:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2515b expref: 62 pid: 6513 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672917.367563:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47b80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876607738454016:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789672917.367586:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672917.373928:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672917.378221:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714259200 00000100:00100000:1.0:1789672917.378236:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714259200 00010000:00010000:1.0:1789672917.378278:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99658c9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25169 expref: 63 pid: 6514 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672917.378320:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:1.0:1789672917.378358:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:2396:x1876607714259200:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672917.378374:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672917.378381:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99658c9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25169 expref: 63 pid: 6514 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.378395:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99658c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25169 expref: 63 pid: 6514 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.378419:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:1.0:1789672917.378424:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.378432:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.378439:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672917.379377:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:2396:x1876607714259200:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 1017us (5455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672917.379386:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:0.0:1789672917.381027:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672917.381166:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714259328 00000100:00100000:3.0:1789672917.381176:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714259328 00010000:00010000:3.0:1789672917.381225:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2515b expref: 63 pid: 6513 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672917.381265:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 73 00000100:00100000:3.0:1789672917.381275:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48233480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:2396:x1876607714259328:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672917.381289:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672917.381295:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2515b expref: 63 pid: 6513 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.381309:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2515b expref: 63 pid: 6513 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.381357:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:3.0:1789672917.381363:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.381372:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.381381:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672917.381400:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672917.381450:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48233480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:2396:x1876607714259328:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 177us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672917.381458:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 73 00010000:00010000:1.0:1789672917.384164:0:6513:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.50@tcp) returned -22 from blocking AST (req@00000000210a7a4f x1876607738453888) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99658c9 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25169 expref: 62 pid: 6514 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.384189:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99658c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25169 expref: 62 pid: 6514 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672917.384457:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47b83480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876607738453888:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672917.384550:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996589f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2515b expref: 61 pid: 6513 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672917.384579:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47b80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876607738454016:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672917.384607:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:1.0:1789672917.384616:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.384625:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.384630:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672917.384654:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789672917.385069:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c99658d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25170 expref: 62 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.385085:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25170 expref: 61 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.385093:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:1.0:1789672917.385096:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789672917.385098:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef400, rc 0) 00000100:00100000:1.0:1789672917.386113:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:11407:x1876607714259072:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 18992us (19358us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789672917.386123:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 121 00000100:00100000:3.0:1789672917.392283:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672917.392466:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714259584 00000100:00100000:0.0:1789672917.392477:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714259584 00000100:00100000:0.0:1789672917.392575:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:0.0:1789672917.392586:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:11407:x1876607714259584:12345-192.168.201.50@tcp:103:lfs.0 00010000:00010000:0.0:1789672917.392602:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672917.392629:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965828 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2513f expref: 61 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672917.392649:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:0.0:1789672917.392654:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672917.392983:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:11407:x1876607714259584:12345-192.168.201.50@tcp:103:lfs.0 Request processed in 397us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672917.392991:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:2.0:1789672917.395638:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672917.397146:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714259712 00000100:00100000:1.0:1789672917.397159:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714259712 00000100:00100000:1.0:1789672917.397239:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 122 00000100:00100000:1.0:1789672917.397265:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:11407:x1876607714259712:12345-192.168.201.50@tcp:58:lfs.0 00010000:00010000:1.0:1789672917.397533:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c99658e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.397553:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c99658e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.397566:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c99658e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789672917.398096:0:11081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1789672917.398229:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:11407:x1876607714259712:12345-192.168.201.50@tcp:58:lfs.0 Request processed in 964us (2599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672917.398239:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 122 00000100:00100000:2.0:1789672917.402458:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672917.402553:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714259840 00000100:00100000:1.0:1789672917.402565:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714259840 00000100:00100000:1.0:1789672917.402711:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 123 00000100:00100000:1.0:1789672917.402723:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:11407:x1876607714259840:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789672917.402743:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672917.402782:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99658ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25177 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.402838:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c99658e5 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.402848:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99658ec lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25177 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.402869:0:6514:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c99658e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.402908:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99658ec lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25177 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.402923:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:1.0:1789672917.402926:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672917.402938:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99658ec lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25177 expref: 61 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672917.402947:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435800, rc 0) 00000100:00100000:1.0:1789672917.403010:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:11407:x1876607714259840:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 290us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672917.403017:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 123 00000040:00080000:1.0:1789672918.019967:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789672918.019978:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789672918.020004:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789672918.020012:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789672918.020146:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1876607738454144:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789672918.020619:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bbad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789672918.042227:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672918.042413:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714259968 00000100:00100000:3.0:1789672918.042423:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714259968 00000100:00100000:3.0:1789672918.042495:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 124 00000100:00100000:3.0:1789672918.042505:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+62:11409:x1876607714259968:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789672918.042544:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789672918.042650:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+62:11409:x1876607714259968:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 147us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672918.042684:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 124 00000100:00080000:2.0:1789672918.043093:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672918.045170:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1876607738454144:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789672918.049555:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672918.050576:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714260096 00000100:00100000:1.0:1789672918.050591:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714260096 00000100:00100000:1.0:1789672918.050713:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 125 00000100:00100000:1.0:1789672918.050724:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:11409:x1876607714260096:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789672918.050813:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99658f3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051189:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99658f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051202:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99658f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051219:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99658fa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051226:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99658fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051233:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99658fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051332:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965901 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051343:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965901 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051352:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965901 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672918.051415:0:11081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789672918.051420:0:11081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789672918.051433:0:11081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965901 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051444:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99658f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051460:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99658f3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051467:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99658f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051473:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672918.051477:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99658f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051485:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99658f3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051497:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfc61501100) 00010000:00010000:1.0:1789672918.051500:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672918.051505:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99658f3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051511:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99658f3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051526:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99658fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051533:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99658fa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051538:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99658fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051543:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672918.051553:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99658fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051558:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99658fa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051565:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8cfc61501e00) 00010000:00010000:1.0:1789672918.051568:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672918.051571:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99658fa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051576:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c99658fa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051592:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965901 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051597:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965901 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051602:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965901 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.051606:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672918.051609:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965901 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.052107:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965901 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.052118:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:1.0:1789672918.052120:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672918.052132:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965901 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.052137:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965901 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672918.052253:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:11409:x1876607714260096:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 Request processed in 1521us (2703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672918.054050:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 125 00000100:00100000:2.0:1789672918.056605:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672918.056819:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714260352 00000100:00100000:1.0:1789672918.056833:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714260352 00000100:00100000:1.0:1789672918.056920:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 126 00000100:00100000:1.0:1789672918.056932:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:11409:x1876607714260352:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672918.056956:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672918.056979:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965908 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2517e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.057095:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996590f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.057112:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996590f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.057126:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996590f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672918.057138:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789672918.057217:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996590f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.057225:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996590f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.057425:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996590f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.057432:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672918.057436:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996590f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.057444:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996590f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.057455:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:1.0:1789672918.057458:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789672918.057463:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996590f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.057468:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c996590f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.057512:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965908 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2517e expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.057521:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfc61501100) 00010000:00010000:1.0:1789672918.057524:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672918.057527:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965908 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2517e expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.057537:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434800, rc 0) 00000100:00100000:1.0:1789672918.057596:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+62:11409:x1876607714260352:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 666us (1002us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1789672918.057612:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 126 00000100:00100000:2.0:1789672918.061223:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672918.061372:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714260480 00000100:00100000:0.0:1789672918.061385:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714260480 00000100:00100000:0.0:1789672918.061450:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 127 00000100:00100000:0.0:1789672918.061460:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+62:11409:x1876607714260480:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789672918.061493:0:9524:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789672918.061626:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+62:11409:x1876607714260480:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 166us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672918.061649:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 127 00000100:00100000:0.0:1789672918.066072:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672918.066428:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714260736 00000100:00100000:1.0:1789672918.066440:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714260736 00000100:00100000:1.0:1789672918.066551:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 128 00000100:00100000:1.0:1789672918.066561:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+62:11409:x1876607714260736:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672918.066582:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672918.066586:0:11081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789672918.066623:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee400/0x6c78c4f8c99658ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25162 expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.066643:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:1.0:1789672918.066647:0:11081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672918.066689:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c996591d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25185 expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789672918.067072:0:11081:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789672918.067210:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965924 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.067223:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965924 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.067234:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965924 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.069005:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c996591d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25185 expref: 64 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.069056:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965924 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25185 expref: 63 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.069065:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cfc61501e00) 00010000:00010000:1.0:1789672918.069068:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672918.069071:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435600, rc 0) 00000100:00100000:1.0:1789672918.069161:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:11409:x1876607714260736:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 2600us (3097us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789672918.069169:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 128 00000100:00100000:2.0:1789672918.093286:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672918.093364:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714260992 00000100:00100000:3.0:1789672918.093374:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714260992 00000100:00100000:3.0:1789672918.093437:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 129 00000100:00100000:3.0:1789672918.093458:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:11409:x1876607714260992:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789672918.093517:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672918.093545:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965924 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25185 expref: 63 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093565:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cfc61501e00) 00010000:00010000:3.0:1789672918.093575:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672918.093596:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965932 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093610:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965932 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093619:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965932 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093633:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965939 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xec1b574 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093640:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965939 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xec1b574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093646:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965939 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xec1b574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093734:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965932 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093751:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965932 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093768:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965932 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093774:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672918.093778:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965932 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093786:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965932 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093794:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:3.0:1789672918.093797:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672918.093801:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965932 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093807:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c9965932 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093815:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965939 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xec1b574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093821:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965939 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xec1b574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093827:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965939 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xec1b574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093832:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672918.093835:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965939 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xec1b574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093850:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965939 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xec1b574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093858:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xec1b574 (ffff8cfb419b0a00) 00010000:00010000:3.0:1789672918.093860:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672918.093863:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965939 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xec1b574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.093868:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965939 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xec1b574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672918.093967:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+62:11409:x1876607714260992:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 506us (686us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789672918.093975:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 129 00000100:00100000:3.0:1789672918.098499:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672918.098590:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714261120 00000100:00100000:2.0:1789672918.098598:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714261120 00000100:00100000:2.0:1789672918.098701:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 130 00000100:00100000:2.0:1789672918.098712:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+62:11409:x1876607714261120:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672918.098732:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672918.098766:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee400/0x6c78c4f8c9965940 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2518c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.098805:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965947 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.098819:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965947 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.098857:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965947 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.098976:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee400/0x6c78c4f8c9965940 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2518c expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.098993:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965947 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2518c expref: 63 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.099002:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cfc4991c000) 00010000:00010000:2.0:1789672918.099005:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789672918.099008:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee800, rc 0) 00000100:00100000:2.0:1789672918.099068:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:11409:x1876607714261120:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 358us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672918.099075:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 130 00000100:00100000:0.0:1789672918.109028:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672918.109423:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714261376 00000100:00100000:1.0:1789672918.109434:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714261376 00000100:00100000:1.0:1789672918.109496:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 131 00000100:00100000:1.0:1789672918.109506:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:11409:x1876607714261376:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789672918.109606:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c996594e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.111052:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c996594e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.111066:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c996594e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789672918.111266:0:11081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1789672918.111439:0:11081:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396026778955ns, next at 397026775330ns, rc = 0 00000004:00010000:0.0:1789672918.111495:0:11081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e4d6232 reply state 00000000e40e0449 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c996594e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.111508:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c996594e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.111516:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cfc4991c000) 00010000:00010000:0.0:1789672918.111519:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789672918.111522:0:11081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789672918.111637:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:11409:x1876607714261376:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 2129us (2616us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789672918.111645:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 131 00000100:00100000:3.0:1789672918.119159:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672918.121050:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714261504 00000100:00100000:1.0:1789672918.121065:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714261504 00000100:00100000:1.0:1789672918.121146:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 132 00000100:00100000:1.0:1789672918.121156:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:11409:x1876607714261504:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672918.121197:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672918.121219:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965955 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25193 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.121407:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965955 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25193 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.121423:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965955 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25193 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.121441:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cfc4991c000) 00010000:00010000:1.0:1789672918.121444:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672918.121448:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434800, rc 0) 00000100:00100000:1.0:1789672918.121578:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+66:11409:x1876607714261504:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 423us (2428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672918.121586:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 132 00000100:00100000:3.0:1789672918.127597:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672918.128019:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714261632 00000100:00100000:0.0:1789672918.128028:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714261632 00000100:00100000:0.0:1789672918.128134:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 45 00000100:00100000:0.0:1789672918.128143:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2398:x1876607714261632:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789672918.128372:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2398:x1876607714261632:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 228us (782us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789672918.128380:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 45 00000100:00080000:2.0:1789672918.130401:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672918.132546:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672918.132650:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714261888 00000100:00100000:3.0:1789672918.132691:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714261888 00000100:00100000:3.0:1789672918.132779:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:3.0:1789672918.132789:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+66:11409:x1876607714261888:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789672918.133024:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:11409:x1876607714261888:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 236us (485us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1789672918.133032:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:1.0:1789672918.137088:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672918.137420:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714262144 00000100:00100000:2.0:1789672918.137431:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714262144 00000100:00100000:2.0:1789672918.137493:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 133 00000100:00100000:2.0:1789672918.137504:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:11409:x1876607714262144:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789672918.137625:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:11409:x1876607714262144:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 123us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672918.137632:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 133 00000100:00100000:0.0:1789672918.142770:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672918.142998:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714262272 00000100:00100000:2.0:1789672918.143009:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714262272 00000100:00100000:2.0:1789672918.143158:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 134 00000100:00100000:2.0:1789672918.143170:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:11409:x1876607714262272:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672918.143210:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672918.143227:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee400/0x6c78c4f8c996595c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2519a expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.143311:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965963 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.143325:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.143337:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672918.143379:0:11081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789672918.143396:0:11081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.143416:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee400/0x6c78c4f8c996595c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2519a expref: 69 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.143430:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965963 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2519a expref: 68 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.143436:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cfc4991c000) 00010000:00010000:2.0:1789672918.143438:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789672918.143441:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef800, rc 0) 00000100:00100000:2.0:1789672918.143491:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+68:11409:x1876607714262272:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 325us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672918.143497:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 134 00000100:00100000:3.0:1789672918.148697:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672918.148799:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714262400 00000100:00100000:2.0:1789672918.148810:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714262400 00000100:00100000:2.0:1789672918.148880:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00100000:2.0:1789672918.148899:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2396:x1876607714262400:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672918.148921:0:8494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672918.148941:0:8494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996596a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd251a1 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789672918.148968:0:8494:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac3dd4, blocks: 0x0 00010000:00010000:2.0:1789672918.148989:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1789672918.148994:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672918.149003:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996596a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a1 expref: 10 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.149022:0:8494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996596a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a1 expref: 10 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.149035:0:8494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee400, rc 0) 00000100:00100000:2.0:1789672918.149086:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+10:2396:x1876607714262400:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 198us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672918.149093:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00100000:3.0:1789672918.152949:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672918.153067:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714262656 00000100:00100000:2.0:1789672918.153076:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714262656 00000100:00100000:2.0:1789672918.153124:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 135 00000100:00100000:2.0:1789672918.153131:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+68:11409:x1876607714262656:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789672918.153218:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+68:11409:x1876607714262656:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 88us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672918.153236:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 135 00000100:00100000:0.0:1789672918.158043:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672918.158144:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714262784 00000100:00100000:2.0:1789672918.158154:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714262784 00000100:00100000:2.0:1789672918.158252:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:2.0:1789672918.158269:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+10:11409:x1876607714262784:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672918.158287:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672918.158307:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053bb90f5/0x6c78c4f8c9965971 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd251a8 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.158338:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996596a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a1 expref: 11 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.158349:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672918.158353:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672918.158358:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053bb90f5/0x6c78c4f8c9965971 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a8 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.158392:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996596a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a1 expref: 11 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.158405:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996596a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a1 expref: 11 pid: 8494 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672918.158420:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1876607738454272:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789672918.158514:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672918.162589:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672918.162712:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714262912 00000100:00100000:0.0:1789672918.162728:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714262912 00010000:00010000:0.0:1789672918.162780:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996596a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a1 expref: 12 pid: 8494 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672918.162821:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 74 00000100:00100000:0.0:1789672918.162831:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc65c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+12:2395:x1876607714262912:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672918.162857:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672918.162878:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996596a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a1 expref: 12 pid: 8494 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.162901:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996596a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a1 expref: 12 pid: 8494 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.162926:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672918.162930:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672918.162938:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053bb90f5/0x6c78c4f8c9965971 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a8 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.162948:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053bb90f5/0x6c78c4f8c9965971 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a8 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.162985:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000053bb90f5/0x6c78c4f8c9965971 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a8 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672918.162998:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48230700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1876607738454400:192.168.201.50@tcp:105: 00000100:00100000:0.0:1789672918.163081:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc52768540 going to sleep for 11 seconds 00010000:00010000:2.0:1789672918.163753:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996596a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a1 expref: 12 pid: 8494 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672918.163771:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1876607738454272:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789672918.163796:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000053bb90f5/0x6c78c4f8c9965971 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a8 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.163807:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aeea00, rc 0) 00000100:00100000:2.0:1789672918.163846:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+11:11409:x1876607714262784:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 5579us (5814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672918.163853:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:0.0:1789672918.168940:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48230700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1876607738454400:192.168.201.50@tcp:105: 00010000:00010000:0.0:1789672918.168971:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672918.169025:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc65c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+10:2395:x1876607714262912:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 6195us (6445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672918.169034:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 74 00000100:00100000:0.0:1789672918.170902:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672918.170981:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714263040 00000100:00100000:2.0:1789672918.170990:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714263040 00002000:00100000:2.0:1789672918.171037:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8cfb48231500 x1876607714263040/t0(0) o4->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:544/0 lens 504/0 e 0 to 0 dl 1789672929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789672918.171046:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfb48231500 with x1876607714263040 ext(0->12) 00002000:00010000:2.0:1789672918.171051:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfb48231500 00000100:00100000:2.0:1789672918.171114:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:2.0:1789672918.171121:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+10:2396:x1876607714263040:12345-192.168.201.50@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789672918.172232:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+12:2396:x1876607714263040:12345-192.168.201.50@tcp:4:lhsmtool_posix.0 Request processed in 1104us (1328us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789672918.172244:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 2 00002000:00100000:2.0:1789672918.172254:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8cfb48231500 x1876607714263040/t4294967309(0) o4->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:544/0 lens 504/448 e 0 to 0 dl 1789672929 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789672918.172353:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfb48231500 with x1876607714263040 ext(0->12) 00002000:00010000:2.0:1789672918.172358:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfb48231500 00000100:00100000:1.0:1789672918.174410:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672918.174606:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714263168 00000100:00100000:0.0:1789672918.174614:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714263168 00000100:00100000:0.0:1789672918.174698:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 136 00000100:00100000:0.0:1789672918.174708:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+68:11409:x1876607714263168:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789672918.176677:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1789672918.176695:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00010000:00010000:0.0:1789672918.176790:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965676 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.176802:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965676 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.176809:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965676 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789672918.176810:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:0.0:1789672918.176816:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aefc00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672918.176820:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965676 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.176828:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965676 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789672918.176844:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfc4b95d240 refcount 2 committed 0 result 0 batchid 3 00010000:00010000:0.0:1789672918.176844:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8cfb46b95000) 00010000:00010000:0.0:1789672918.176847:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1789672918.176848:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc7dbbaa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfc464a5a80 00000020:00080000:3.0:1789672918.176851:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc7dbba400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cfb48059c00 00010000:00010000:0.0:1789672918.176852:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965676 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.176871:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965676 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789672918.176874:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:0.0:1789672918.176900:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c996571e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.176908:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c996571e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.176914:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c996571e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.176919:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672918.176922:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c996571e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.176927:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c996571e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.176935:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8cfc61501300) 00010000:00010000:0.0:1789672918.176937:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672918.176940:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c996571e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.176944:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c996571e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.176958:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c996579c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.176964:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c996579c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.176974:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c996579c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.176979:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672918.176982:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c996579c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.176988:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c996579c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.176995:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfb419b0d00) 00000100:00100000:1.0:1789672918.176996:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1789672918.176997:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672918.177001:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c996579c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177006:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c996579c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672918.177012:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738454528:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789672918.177017:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c99657bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177022:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c99657bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177027:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c99657bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177031:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672918.177033:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c99657bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177046:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c99657bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177053:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfb419b0d00) 00010000:00010000:0.0:1789672918.177055:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672918.177058:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c99657bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177063:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c99657bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672918.177072:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789672918.177078:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965891 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177084:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965891 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177088:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965891 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177093:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aefe00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672918.177095:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965891 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177101:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965891 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177108:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:0.0:1789672918.177110:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789672918.177113:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738454528 00010000:00010000:0.0:1789672918.177113:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965891 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672918.177119:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738454528 00010000:00010000:0.0:1789672918.177126:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965891 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177137:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c996594e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177142:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c996594e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177148:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c996594e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177152:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672918.177155:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c996594e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177160:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c996594e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177168:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cfc4991c000) 00010000:00010000:0.0:1789672918.177170:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789672918.177173:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c996594e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177178:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c996594e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672918.177186:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789672918.177194:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3637:x1876607738454528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789672918.177218:0:8494:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:1.0:1789672918.177248:0:8494:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aac3dd3, atime: 0x6aac3dd3, ctime: 0x6aac3dd3, blocks: 0x8 00010000:00010000:1.0:1789672918.177484:0:8494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965978 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.177498:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:1.0:1789672918.177503:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672918.177509:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.177525:0:8494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.177534:0:8494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.177541:0:8494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.177561:0:8494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789672918.177723:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3637:x1876607738454528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 528us (649us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789672918.177730:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:0.0:1789672918.177793:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672918.177800:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177818:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434c00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789672918.177821:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177829:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965978 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177842:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965978 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177849:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965978 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.177864:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672918.177866:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672918.177867:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789672918.178004:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789672918.179361:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfc7f715c00/2, rc 0, transno 4294967305 00000100:00100000:1.0:1789672918.179371:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738454528:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1789672918.179573:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789672918.179578:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738454656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789672918.179626:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672918.179678:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672918.179683:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738454656 00000100:00100000:0.0:1789672918.179685:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738454784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789672918.179689:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738454656 00000100:00100000:2.0:1789672918.179735:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789672918.179755:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3635:x1876607738454656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789672918.179779:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1789672918.179801:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996597f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.179820:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c996572c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25100 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.179828:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=3s v=(0 0) 00000100:00100000:0.0:1789672918.179839:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789672918.179843:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789672918.179848:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996597f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.179874:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c996572c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25100 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672918.179876:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738454784 00000100:00100000:0.0:1789672918.179879:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738454784 00010000:00010000:2.0:1789672918.179887:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c996572c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25100 expref: 11 pid: 8430 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672918.179914:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f649880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8428:1876607738454912:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789672918.179914:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789672918.179920:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3635:x1876607738454784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789672918.179974:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b3c0 going to sleep for 11 seconds 00000100:00080000:2.0:1789672918.179986:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789672918.180011:0:8494:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789672918.180015:0:8494:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789672916 00002000:00010000:0.0:1789672918.180017:0:8494:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789672918.180019:0:8494:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789672916 -> 1789672916 00002000:00010000:0.0:1789672918.180021:0:8494:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789672918.180062:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3635:x1876607738454784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 141us (221us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789672918.180069:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1789672918.180161:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfc7f64a300/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789672918.180178:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738454784:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1789672918.180388:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1789672918.180396:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000020:00080000:3.0:1789672918.181600:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfb479ee480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789672918.181608:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc66ff1400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfb479ee6c0 00000020:00080000:3.0:1789672918.181611:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc66ff1e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cfc7d870200 00000020:00080000:3.0:1789672918.181635:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:1.0:1789672918.181775:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+16:11409:x1876607714263168:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 Request processed in 7066us (7369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672918.181794:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 136 00000020:00080000:0.0:1789672918.181838:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789672918.181895:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789672918.184456:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672918.185709:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714263296 00000100:00100000:3.0:1789672918.185721:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714263296 00010000:00010000:3.0:1789672918.185776:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c996572c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25100 expref: 12 pid: 8430 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672918.185823:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 75 00000100:00100000:3.0:1789672918.185843:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+12:2396:x1876607714263296:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672918.185858:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672918.185864:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c996572c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25100 expref: 12 pid: 8430 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.185877:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c996572c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25100 expref: 12 pid: 8430 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.185914:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672918.185931:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672918.185938:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996597f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.185948:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996597f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.185971:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672918.186038:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+12:2396:x1876607714263296:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 205us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672918.186045:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 75 00000100:00100000:3.0:1789672918.187225:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672918.187417:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714263424 00000100:00100000:0.0:1789672918.187425:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714263424 00000100:00100000:0.0:1789672918.187461:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:0.0:1789672918.187469:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+12:2396:x1876607714263424:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1789672918.187481:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c996572c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25100 expref: 12 pid: 8430 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672918.187502:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f649880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8428:1876607738454912:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789672918.187530:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996597f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.187542:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996597f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.187549:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996597f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.187562:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996597f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.187570:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996597f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.187611:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789672918.187804:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3635:x1876607738454656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8060us (8177us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789672918.187812:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1789672918.188023:0:13186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672918.188030:0:13186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996597f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.188038:0:13186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aee400 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789672918.188043:0:13186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996597f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.188053:0:13186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996597f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.188071:0:13186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996597f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.188086:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bba14125/0x6c78c4f8c996597f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.188105:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672918.188107:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672918.188108:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789672918.188154:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfc7f64a680/2, rc 0, transno 4294967311 00000100:00100000:2.0:1789672918.188161:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738454656:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1789672918.189992:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1789672918.190006:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1789672918.190156:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714263424:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 Request processed in 2683us (2930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672918.190166:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:0.0:1789672918.194419:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672918.194506:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714263680 00000100:00100000:2.0:1789672918.194517:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714263680 00000100:00100000:2.0:1789672918.194577:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 137 00000100:00100000:2.0:1789672918.194588:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+16:11409:x1876607714263680:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789672918.194641:0:11081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672918.194715:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965963 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2519a expref: 16 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.194738:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cfc4991c000) 00010000:00010000:2.0:1789672918.194752:0:11081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672918.194780:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965986 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.194795:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965986 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.194805:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965986 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789672918.194954:0:11081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1318c26 reply state 000000000993c3a5 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965986 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.194979:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965986 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.194985:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cfc4991c000) 00010000:00010000:2.0:1789672918.194988:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789672918.194991:0:11081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789672918.195085:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+17:11409:x1876607714263680:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 498us (673us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1789672918.195093:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 137 00000100:00100000:1.0:1789672918.199004:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672918.199136:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714263808 00000100:00100000:0.0:1789672918.199147:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714263808 00000100:00100000:0.0:1789672918.199213:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:0.0:1789672918.199224:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2395:x1876607714263808:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789672918.199395:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789672918.199399:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789672916 -> 1789672915 00002000:00010000:0.0:1789672918.199401:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789672915 00002000:00010000:0.0:1789672918.199404:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789672916 -> 1789672915 00002000:00010000:0.0:1789672918.199406:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789672918.199470:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2395:x1876607714263808:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 247us (474us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789672918.199478:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:3.0:1789672918.204943:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672918.209837:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714264064 00000100:00100000:2.0:1789672918.209854:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714264064 00010000:00010000:2.0:1789672918.211861:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672918.214578:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 138 00000100:00100000:3.0:1789672918.214592:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+17:11409:x1876607714264064:12345-192.168.201.50@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789672918.214681:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996598d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.214702:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965947 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2518c expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.214711:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996598d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.214756:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965947 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2518c expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.214789:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965947 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2518c expref: 17 pid: 6512 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672918.214805:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4824df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738455040:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672918.216111:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d8059c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672918.225982:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4824df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738455040:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789672918.226016:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996598d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672918.232519:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672918.233228:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714264192 00000100:00100000:0.0:1789672918.233250:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714264192 00010000:00010000:0.0:1789672918.233308:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965947 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2518c expref: 18 pid: 6512 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672918.233387:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 76 00000100:00100000:0.0:1789672918.233398:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+18:2395:x1876607714264192:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672918.233415:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672918.233422:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965947 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2518c expref: 18 pid: 6512 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.233435:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965947 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2518c expref: 18 pid: 6512 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.233458:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965947 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2518c expref: 18 pid: 6512 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.233474:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cfc4991c000) 00010000:00010000:0.0:1789672918.233480:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996598d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.233490:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996598d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.233498:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996598d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.233534:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672918.233599:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+17:2395:x1876607714264192:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 202us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672918.233607:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 76 00010000:00010000:1.0:1789672918.233815:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996598d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.233825:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996598d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.233868:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996598d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.238615:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996598d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.238631:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996598d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.238638:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672918.238642:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996598d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.238652:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996598d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.238702:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cfc4991c000) 00010000:00010000:1.0:1789672918.238705:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789672918.238710:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996598d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.238717:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c996598d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672918.239344:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+16:11409:x1876607714264064:12345-192.168.201.50@tcp:55:lhsmtool_posix.0 Request processed in 24739us (34395us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789672918.239365:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 138 00000100:00100000:3.0:1789672918.243536:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672918.243622:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714264320 00000100:00100000:1.0:1789672918.243632:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714264320 00000100:00100000:1.0:1789672918.243718:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:1.0:1789672918.243728:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc818f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2395:x1876607714264320:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789672918.243785:0:8494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c9965994 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.243808:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000053bb90f5/0x6c78c4f8c9965971 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a8 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.243818:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672918.243823:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789672918.243827:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c9965994 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.243864:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000053bb90f5/0x6c78c4f8c9965971 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a8 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.243877:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000053bb90f5/0x6c78c4f8c9965971 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a8 expref: 7 pid: 8430 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672918.243892:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8494:1876607738455168:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672918.244174:0:8494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb46884cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672918.251260:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672918.251359:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714264448 00000100:00100000:3.0:1789672918.251369:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714264448 00010000:00010000:3.0:1789672918.251410:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000053bb90f5/0x6c78c4f8c9965971 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a8 expref: 8 pid: 8430 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672918.251456:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 77 00000100:00100000:3.0:1789672918.251466:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2395:x1876607714264448:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672918.251482:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672918.251507:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000053bb90f5/0x6c78c4f8c9965971 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a8 expref: 8 pid: 8430 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.251520:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000053bb90f5/0x6c78c4f8c9965971 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a8 expref: 8 pid: 8430 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.251566:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672918.251571:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672918.251576:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c9965994 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.251586:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c9965994 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.251607:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672918.251686:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48231c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2395:x1876607714264448:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 221us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672918.251694:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 77 00010000:00010000:1.0:1789672918.252424:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053bb90f5/0x6c78c4f8c9965971 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251a8 expref: 7 pid: 8430 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672918.252454:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8494:1876607738455168:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672918.252479:0:8494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c9965994 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.252489:0:8494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c9965994 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.252496:0:8494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c9965994 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.252520:0:8494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c9965994 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.252527:0:8494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c9965994 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.252536:0:8494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c9965994 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.252542:0:8494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434600 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789672918.252546:0:8494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c9965994 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.252555:0:8494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c9965994 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.252577:0:8494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c9965994 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.252585:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c9965994 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672918.252637:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc818f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2395:x1876607714264320:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 Request processed in 8910us (9111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672918.252645:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:2.0:1789672918.270113:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672918.270203:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714264704 00000100:00100000:1.0:1789672918.270214:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714264704 00000100:00100000:1.0:1789672918.270291:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 139 00000100:00100000:1.0:1789672918.270301:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+16:11409:x1876607714264704:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789672918.270397:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c996599b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.270414:0:9524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996588a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25154 expref: 16 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.270423:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c996599b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.270460:0:9524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996588a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25154 expref: 16 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.270474:0:9524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996588a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25154 expref: 16 pid: 9524 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672918.270505:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876607738455296:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672918.270587:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb46884cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672918.278139:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876607738455296:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789672918.278150:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00010000:00010000:1.0:1789672918.278175:0:9524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c996599b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672918.278248:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714264832 00000100:00100000:0.0:1789672918.278255:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714264832 00010000:00010000:0.0:1789672918.278294:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996588a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25154 expref: 17 pid: 9524 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672918.278337:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 78 00000100:00100000:0.0:1789672918.278347:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+17:2395:x1876607714264832:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672918.278361:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672918.278368:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996588a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25154 expref: 17 pid: 9524 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.278380:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996588a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25154 expref: 17 pid: 9524 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.278403:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c996588a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25154 expref: 17 pid: 9524 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.278419:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:0.0:1789672918.278425:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99658ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25177 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.278435:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c996599b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.278443:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c996599b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.278464:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c996599b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.278487:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672918.278547:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+16:2395:x1876607714264832:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 200us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672918.278554:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 78 00010000:00010000:1.0:1789672918.278701:0:9524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c996599b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.278711:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c996599b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.278946:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99659a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.278960:0:9524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965955 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25193 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.278968:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99659a2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.278996:0:9524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965955 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25193 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672918.279010:0:9524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965955 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25193 expref: 16 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672918.279024:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48230e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876607738455424:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789672918.279090:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc52768480 going to sleep for 11 seconds 00000100:00100000:0.0:1789672918.284358:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48230e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876607738455424:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789672918.284390:0:9524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99659a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672918.285649:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672918.285784:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714264960 00000100:00100000:3.0:1789672918.285793:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714264960 00010000:00010000:3.0:1789672918.285835:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965955 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25193 expref: 17 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672918.285872:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 79 00000100:00100000:3.0:1789672918.285882:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+17:2396:x1876607714264960:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672918.285898:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672918.285905:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965955 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25193 expref: 17 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.285918:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965955 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25193 expref: 17 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.285956:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965955 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25193 expref: 17 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.285971:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cfc4991c000) 00010000:00010000:3.0:1789672918.285976:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99659a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.285985:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99659a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.285993:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99659a2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.286030:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672918.286089:0:9524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99659a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672918.286092:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+16:2396:x1876607714264960:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 209us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672918.286107:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 79 00010000:00010000:1.0:1789672918.286107:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99659a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789672918.286230:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1789672918.286348:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1789672918.286383:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1789672918.286457:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9524:1876607738455552:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789672918.286504:0:9524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672918.286540:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5510c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672918.286704:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738455552 00000100:00100000:0.0:1789672918.286710:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738455552 00000100:00100000:0.0:1789672918.286757:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789672918.286765:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9524:x1876607738455552:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789672918.286844:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9524:x1876607738455552:12345-0@lo:1000:mdt00_003.0 Request processed in 81us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672918.286852:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789672918.287914:0:9524:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1789672918.287922:0:9524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:1.0:1789672918.287944:0:9524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfc7f64a300, transno 4294967310 00000004:00080000:1.0:1789672918.288136:0:9524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfc7f64a680, transno 4294967311 00000100:00100000:1.0:1789672918.288253:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9524:1876607738455552:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789672918.288389:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1789672918.288451:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9524:1876607738455680:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789672918.288502:0:9524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672918.288536:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc430b4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672918.289977:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738455680 00000100:00100000:3.0:1789672918.289990:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738455680 00000100:00100000:3.0:1789672918.290054:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789672918.290065:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9524:x1876607738455680:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789672918.290251:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9524:x1876607738455680:12345-0@lo:1000:mdt00_003.0 Request processed in 188us (1747us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789672918.290260:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789672918.290285:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9524:1876607738455680:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789672918.290330:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99659a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.290340:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99659a2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.290348:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99659a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.290353:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cda00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672918.290357:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99659a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.290365:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99659a2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.290378:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cfc4991c000) 00010000:00010000:1.0:1789672918.290381:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672918.290385:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99659a2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.290391:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c99659a2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.290414:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c99658e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.290432:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c99658e5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.290438:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c99658e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.290442:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434e00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672918.290445:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c99658e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.290451:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c99658e5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.290458:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:1.0:1789672918.290461:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672918.290467:0:9524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99658ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25177 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.290478:0:9524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99658ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25177 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.290488:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99658ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25177 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.290522:0:9524:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99658ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25177 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672918.290535:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd43b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876607738455808:192.168.201.50@tcp:105: 00000100:00100000:1.0:1789672918.290681:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7442d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672918.294137:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672918.294293:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd43b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876607738455808:192.168.201.50@tcp:105: 00010000:00010000:1.0:1789672918.294324:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c99658e5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.294336:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434e00/0x6c78c4f8c99658e5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672918.294357:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714265088 00000100:00100000:3.0:1789672918.294366:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714265088 00010000:00010000:1.0:1789672918.294370:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99659a9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.294386:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99659a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.294398:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99659a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.294408:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99659a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.294414:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99659a9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.294420:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99659a9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.294426:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672918.294431:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99659a9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672918.294432:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 31 00010000:00010000:1.0:1789672918.294443:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99659a9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672918.294448:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:11407:x1876607714265088:12345-192.168.201.50@tcp:49:lfs.0 00010000:00010000:1.0:1789672918.294482:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:1.0:1789672918.294485:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672918.294489:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99659a9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.294495:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99659a9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.294505:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c996599b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.294511:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c996599b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.294517:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c996599b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.294522:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672918.294525:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c996599b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.294532:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c996599b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.294541:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:1.0:1789672918.294543:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789672918.294546:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c996599b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.294552:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c996599b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672918.294602:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:11407:x1876607714265088:12345-192.168.201.50@tcp:49:lfs.0 Request processed in 158us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672918.294622:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:1.0:1789672918.294720:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:11409:x1876607714264704:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 24420us (24616us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789672918.294729:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 139 00000020:00080000:1.0:1789672918.294732:0:9524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789672918.294773:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672918.294780:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789672918.297396:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789672918.297417:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789672918.298982:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672918.299029:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672918.299090:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714265344 00000100:00100000:1.0:1789672918.299101:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714265344 00000100:00100000:3.0:1789672918.299229:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714265600 00000100:00100000:3.0:1789672918.299235:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714265600 00000100:00100000:1.0:1789672918.299379:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 140 00000100:00100000:1.0:1789672918.299390:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:11407:x1876607714265344:12345-192.168.201.50@tcp:58:lfs.0 00000040:00080000:1.0:1789672918.299552:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789672918.299641:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:11407:x1876607714265344:12345-192.168.201.50@tcp:58:lfs.0 Request processed in 252us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672918.299650:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 140 00000100:00100000:3.0:1789672918.299776:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:3.0:1789672918.299786:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f850050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:11409:x1876607714265600:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789672918.299975:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789672918.300006:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1789672918.300039:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c99659b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.300054:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c99659b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.300066:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c99659b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.300075:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c99659b0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.300081:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c99659b0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.300087:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c99659b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.300120:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789672918.300143:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672918.300151:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c99659b0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.300160:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887200 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789672918.300165:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c99659b0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672918.300170:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f850050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:11409:x1876607714265600:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 383us (1138us total) trans 4294967410 rc 0/0 00010000:00010000:1.0:1789672918.300179:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c99659b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672918.300184:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 32 00000020:00080000:3.0:1789672918.300191:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789672918.300264:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cfc4991c000) 00010000:00010000:1.0:1789672918.300267:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789672918.300272:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c99659b0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.300288:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c99659b0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672918.300299:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672918.300301:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672918.300302:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672918.339884:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738455936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789672918.339971:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672918.340101:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738455936 00000100:00100000:3.0:1789672918.340112:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738455936 00000100:00100000:3.0:1789672918.340212:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789672918.340223:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738455936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789672918.340265:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789672918.340480:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738456064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672918.340513:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672918.340535:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738456192:0@lo:400:kworker.0 00000100:00100000:0.0:1789672918.340561:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672918.340587:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789672918.340592:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738456576:0@lo:400:kworker.0 00000100:00100000:0.0:1789672918.340616:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672918.340644:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738456064 00000100:00100000:0.0:1789672918.340649:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738456064 00000100:00100000:0.0:1789672918.341334:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789672918.341347:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738456064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672918.341363:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789672918.341411:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738456064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672918.341418:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789672918.341442:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738456192 00000100:00100000:0.0:1789672918.341447:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738456192 00000100:00100000:0.0:1789672918.341474:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789672918.341495:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738456192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672918.341528:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738456192:12345-0@lo:400:kworker.0 Request processed in 34us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672918.341534:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789672918.341579:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1789672918.341584:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:0.0:1789672918.341601:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfc7f67a300, transno 4294967302 00000004:00080000:0.0:1789672918.341610:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1789672918.341622:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfc7f715c00, transno 4294967305 00000100:00100000:0.0:1789672918.341633:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738456064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672918.341644:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738456192:0@lo:400:kworker.0 00000100:00100000:0.0:1789672918.342023:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738456576 00000100:00100000:0.0:1789672918.342029:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738456576 00000100:00100000:0.0:1789672918.342061:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789672918.342068:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738456576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672918.342110:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738456576:12345-0@lo:400:kworker.0 Request processed in 43us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672918.342117:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789672918.342141:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738456576:0@lo:400:kworker.0 00000100:00100000:3.0:1789672918.342395:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738455936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2172us (2422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672918.342400:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738455936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789672918.342407:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789672918.342524:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738457088:0@lo:400:kworker.0 00000100:00100000:2.0:1789672918.342536:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738456320:0@lo:400:kworker.0 00000100:00100000:1.0:1789672918.342565:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672918.342577:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672918.342603:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738456832:0@lo:400:kworker.0 00000100:00100000:2.0:1789672918.342622:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672918.342637:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738457344:0@lo:400:kworker.0 00000100:00100000:1.0:1789672918.342675:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789672918.342683:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738456704:0@lo:400:kworker.0 00000100:00100000:3.0:1789672918.342696:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738457088 00000100:00100000:3.0:1789672918.342702:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738457088 00000100:00100000:1.0:1789672918.342714:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672918.342736:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738457216:0@lo:400:kworker.0 00000100:00100000:1.0:1789672918.342784:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738456320 00000100:00100000:1.0:1789672918.342788:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738456320 00000100:00100000:1.0:1789672918.342816:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738456832 00000100:00100000:3.0:1789672918.342820:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789672918.342820:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738456832 00000100:00100000:3.0:1789672918.342834:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738457088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672918.342855:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789672918.342865:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738456320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672918.342882:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738457088:12345-0@lo:400:kworker.0 Request processed in 51us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672918.342890:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789672918.342906:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738456320:12345-0@lo:400:kworker.0 Request processed in 43us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672918.342913:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789672918.342929:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789672918.342935:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738456832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672918.342983:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672918.342983:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738456832:12345-0@lo:400:kworker.0 Request processed in 45us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672918.342992:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789672918.343019:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738457344 00000100:00100000:2.0:1789672918.343020:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738456320:0@lo:400:kworker.0 00000100:00100000:1.0:1789672918.343024:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738457344 00000100:00100000:2.0:1789672918.343037:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738456832:0@lo:400:kworker.0 00000100:00100000:1.0:1789672918.343048:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789672918.343056:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738457344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672918.343061:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789672918.343072:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738456448:0@lo:400:kworker.0 00000100:00100000:1.0:1789672918.343090:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738457344:12345-0@lo:400:kworker.0 Request processed in 35us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672918.343097:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789672918.343108:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672918.343186:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738456960:0@lo:400:kworker.0 00000100:00100000:2.0:1789672918.343208:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672918.343551:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738456704 00000100:00100000:3.0:1789672918.343558:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738456704 00000100:00100000:3.0:1789672918.343584:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738456448 00000100:00100000:3.0:1789672918.343587:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738456448 00000100:00100000:3.0:1789672918.343602:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789672918.343608:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738456704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672918.343684:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738456704:12345-0@lo:400:kworker.0 Request processed in 75us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672918.343691:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789672918.343698:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789672918.343708:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738456448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672918.343755:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738456448:12345-0@lo:400:kworker.0 Request processed in 49us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672918.343761:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:3.0:1789672918.344129:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789672918.344134:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789672918.344136:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789672918.344139:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672918.344398:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672918.344442:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738457088:0@lo:400:kworker.0 00000100:00100000:3.0:1789672918.344461:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738456704:0@lo:400:kworker.0 00010000:00080000:2.0:1789672918.344524:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f649c00 x1876607738457344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672918.344535:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738457344:0@lo:400:kworker.0 00000100:00100000:2.0:1789672918.344551:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738456448:0@lo:400:kworker.0 00000100:00100000:2.0:1789672918.344570:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738456960 00000100:00100000:2.0:1789672918.344574:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738456960 00000100:00100000:0.0:1789672918.344624:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738457216 00000100:00100000:0.0:1789672918.344629:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738457216 00000100:00100000:2.0:1789672918.346216:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789672918.346229:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738456960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672918.346331:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738456960:12345-0@lo:400:kworker.0 Request processed in 104us (3121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672918.346337:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00010000:00080000:2.0:1789672918.346376:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f64ad80 x1876607738456960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672918.346389:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738456960:0@lo:400:kworker.0 00000100:00100000:1.0:1789672918.346712:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789672918.346723:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738457216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672918.346786:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738457216:12345-0@lo:400:kworker.0 Request processed in 67us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672918.346792:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789672918.346824:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738457216:0@lo:400:kworker.0 00000100:00100000:2.0:1789672918.347041:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672918.347062:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714265728 00000100:00100000:2.0:1789672918.347069:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714265728 00000100:00100000:2.0:1789672918.347099:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 141 00000100:00100000:2.0:1789672918.347106:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:11411:x1876607714265728:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789672918.347140:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672918.347162:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c99659b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd251af expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.347224:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99659be lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.347485:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99659be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.347500:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99659be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.347516:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99659c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.347524:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99659c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.347532:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99659c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.347606:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99659cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.347618:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25170 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.347626:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99659cc lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.347677:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25170 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.347698:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25170 expref: 22 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672918.347712:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738457472:192.168.201.50@tcp:104: 00000100:00080000:3.0:1789672918.348140:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789672918.348146:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789672918.348389:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789672918.352252:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738457472:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789672918.352283:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99659cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672918.353093:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672918.353239:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714265984 00000100:00100000:3.0:1789672918.353247:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714265984 00000100:00100000:3.0:1789672918.353309:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:3.0:1789672918.353320:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+23:6168:x1876607714265984:12345-192.168.201.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789672918.353640:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+24:6168:x1876607714265984:12345-192.168.201.50@tcp:35:ldlm_bl.0 Request processed in 321us (549us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789672918.353648:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:0.0:1789672918.356269:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672918.357044:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714266112 00000100:00100000:3.0:1789672918.357054:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714266112 00010000:00010000:3.0:1789672918.357094:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25170 expref: 24 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672918.357181:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 80 00000100:00100000:3.0:1789672918.357191:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48230e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+24:2396:x1876607714266112:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672918.357221:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672918.357229:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25170 expref: 24 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.357253:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25170 expref: 24 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.357275:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99658d7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25170 expref: 24 pid: 6513 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.357292:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:3.0:1789672918.357298:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99659cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.357309:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99659cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.357316:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99659cc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672918.357347:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672918.357404:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48230e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+23:2396:x1876607714266112:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 215us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672918.357412:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 80 00010000:00010000:2.0:1789672918.357473:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99659cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.357481:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99659cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672918.357536:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789672918.357540:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789672918.357560:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99659cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.357574:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99659cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.357583:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99659be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.357590:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99659be lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.357604:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99659be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.357610:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aeee00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672918.357615:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99659be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.357623:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99659be lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.357632:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:2.0:1789672918.357635:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672918.357639:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99659be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.357645:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c99659be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.357655:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99659c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.357706:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99659c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.357711:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99659c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.357715:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aeec00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672918.357718:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99659c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.357733:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99659c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.357751:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8cfc4991ca00) 00010000:00010000:2.0:1789672918.357754:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672918.358363:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99659c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.358373:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c99659c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.358412:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c99659b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251af expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.358425:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99659cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251af expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672918.358432:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:2.0:1789672918.358435:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672918.358437:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aeea00, rc 0) 00000100:00100000:2.0:1789672918.358503:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:11411:x1876607714265728:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 11396us (11463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672918.358510:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 141 00000040:00080000:3.0:1789672919.100361:0:14258:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672919.100370:0:14258:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789672919.100404:0:14258:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789672919.100413:0:14258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789672919.238963:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789672919.300521:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672919.300540:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789672919.300568:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789672919.300579:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789672919.300739:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4824ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1876607738457600:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789672919.300881:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d8056c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672919.303824:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4824ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1876607738457600:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789672919.306313:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672919.306377:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714266240 00000100:00100000:0.0:1789672919.306387:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714266240 00000100:00100000:0.0:1789672919.306526:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 142 00000100:00100000:0.0:1789672919.306550:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:11423:x1876607714266240:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789672919.306586:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789672919.307074:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:11423:x1876607714266240:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 171us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672919.307085:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 142 00000100:00100000:2.0:1789672919.310422:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672919.310514:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714266496 00000100:00100000:1.0:1789672919.310525:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714266496 00000100:00100000:1.0:1789672919.310583:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 143 00000100:00100000:1.0:1789672919.310593:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:11423:x1876607714266496:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672919.310635:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672919.310704:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99659d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd251b6 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672919.310824:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99659da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672919.310839:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99659da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672919.310852:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99659da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672919.310926:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789672919.311034:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c99659d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251b6 expref: 25 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672919.311054:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99659da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251b6 expref: 24 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672919.311062:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:1.0:1789672919.311065:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672919.311069:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434600, rc 0) 00000100:00100000:1.0:1789672919.311155:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+24:11423:x1876607714266496:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 563us (742us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789672919.311162:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 143 00000100:00100000:0.0:1789672919.315639:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672919.315819:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714266752 00000100:00100000:2.0:1789672919.315829:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714266752 00000100:00100000:2.0:1789672919.315900:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 144 00000100:00100000:2.0:1789672919.315924:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+24:11423:x1876607714266752:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789672919.316002:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99659e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672919.316020:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99659e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672919.316032:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99659e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672919.316182:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99659e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672919.316200:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99659e8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672919.316208:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99659e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672919.316214:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aef800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672919.316218:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99659e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672919.316225:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99659e8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672919.316237:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:2.0:1789672919.316240:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789672919.316245:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99659e8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672919.316252:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c99659e8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672919.316375:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:11423:x1876607714266752:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 453us (744us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789672919.316383:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 144 00000040:00080000:1.0:1789672919.317478:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789672919.317485:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789672919.318065:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789672919.318083:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789672919.321806:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672919.321946:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714266880 00000100:00100000:0.0:1789672919.321956:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714266880 00000100:00100000:0.0:1789672919.322025:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:0.0:1789672919.322041:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f868050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:2396:x1876607714266880:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672919.322059:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672919.322081:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c99659da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251b6 expref: 25 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672919.322100:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:0.0:1789672919.322104:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672919.322264:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f868050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+24:2396:x1876607714266880:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 224us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672919.322273:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:2.0:1789672919.326566:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672919.326687:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714267136 00000100:00100000:1.0:1789672919.326697:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714267136 00000100:00100000:1.0:1789672919.326760:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:1.0:1789672919.326770:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+24:11423:x1876607714267136:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789672919.327253:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:11423:x1876607714267136:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 483us (694us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789672919.327262:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:1.0:1789672919.875963:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4824ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738457728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789672919.876019:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738457856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672919.876040:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672919.876070:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738457728 00000100:00100000:3.0:1789672919.876077:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738457728 00000100:00100000:3.0:1789672919.876129:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789672919.876139:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738457728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789672919.876162:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1789672919.878795:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738457728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2602us (2698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672919.878809:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789672919.881299:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4824ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738457728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789672919.881928:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672919.884736:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738457856 00000100:00100000:3.0:1789672919.884751:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738457856 00000100:00100000:3.0:1789672919.884831:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789672919.884842:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876607738457856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672919.884868:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1789672919.884956:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1876607738457856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (3029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672919.884964:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789672919.885013:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738457856:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789672920.262552:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672920.901652:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738457984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789672920.901751:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672920.901831:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738457984 00000100:00100000:2.0:1789672920.901839:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738457984 00000100:00100000:2.0:1789672920.901888:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789672920.901897:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738457984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789672920.901931:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789672920.901975:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738457984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672920.901982:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789672920.902027:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738457984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789672921.042307:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672921.042339:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672921.042351:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714267392 00000100:00100000:0.0:1789672921.042360:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714267392 00000100:00100000:2.0:1789672921.042371:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672921.042414:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672921.042419:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714267904 00000100:00100000:0.0:1789672921.042422:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714267904 00000100:00100000:2.0:1789672921.042434:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672921.042444:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 311 00000100:00100000:2.0:1789672921.042452:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672921.042454:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:2396:x1876607714267392:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672921.042470:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672921.042494:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714267520 00000100:00100000:2.0:1789672921.042498:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714267520 00000100:00100000:2.0:1789672921.042515:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714268032 00000100:00100000:2.0:1789672921.042518:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714268032 00000100:00100000:0.0:1789672921.042530:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:2396:x1876607714267392:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672921.042533:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 312 00000100:00100000:2.0:1789672921.042539:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714267904:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672921.042543:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 311 00000100:00100000:0.0:1789672921.042560:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 313 00000100:00100000:2.0:1789672921.042563:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714267904:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 25us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672921.042566:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714267520:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672921.042569:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 312 00000100:00100000:2.0:1789672921.042579:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 314 00000100:00100000:2.0:1789672921.042585:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714268032:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672921.042602:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714267520:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672921.042605:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714268032:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 20us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672921.042609:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 313 00000100:00100000:2.0:1789672921.042612:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 314 00000100:00100000:1.0:1789672921.042687:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714267648 00000100:00100000:1.0:1789672921.042704:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714267648 00000100:00100000:1.0:1789672921.042735:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714267776 00000100:00100000:1.0:1789672921.042738:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714267776 00000100:00100000:3.0:1789672921.042739:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 109 00000100:00100000:3.0:1789672921.042748:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714267648:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672921.042760:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 110 00000100:00100000:1.0:1789672921.042766:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714267776:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672921.042781:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714267648:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 36us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672921.042787:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714267776:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 22us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672921.042788:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 109 00000100:00100000:1.0:1789672921.042793:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 110 00000100:00080000:3.0:1789672921.042806:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789672921.042810:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789672921.042813:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789672921.042814:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672921.042823:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714267264 00000100:00100000:3.0:1789672921.042826:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714267264 00000100:00100000:3.0:1789672921.042869:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 388 00000100:00100000:3.0:1789672921.042876:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2396:x1876607714267264:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672921.042903:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2396:x1876607714267264:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 27us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672921.042909:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 388 00000040:00080000:2.0:1789672921.266937:0:14309:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789672921.266947:0:14309:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789672921.266977:0:14309:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789672921.266984:0:14309:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789672921.284014:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672921.394452:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672921.394532:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714268288 00000100:00100000:3.0:1789672921.394542:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714268288 00000100:00100000:3.0:1789672921.394605:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 145 00000100:00100000:3.0:1789672921.394616:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:11443:x1876607714268288:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789672921.394637:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672921.394682:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99659ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd251bd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672921.394805:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c99659f6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672921.394820:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c99659f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672921.394849:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c99659f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672921.394862:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789672921.394971:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c99659ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251bd expref: 28 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672921.394989:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c99659f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251bd expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672921.394998:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:3.0:1789672921.395001:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789672921.395004:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887a00, rc 0) 00000100:00100000:3.0:1789672921.395062:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+27:11443:x1876607714268288:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 448us (618us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789672921.395070:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 145 00000100:00100000:3.0:1789672921.405343:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672921.405472:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714268416 00000100:00100000:2.0:1789672921.405482:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714268416 00000100:00100000:2.0:1789672921.405543:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 146 00000100:00100000:2.0:1789672921.405553:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+27:11443:x1876607714268416:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:2.0:1789672921.405619:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965a04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672921.405635:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672921.405691:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672921.405732:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672921.405739:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965a04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672921.405746:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965a04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672921.405751:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aefc00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672921.405755:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965a04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672921.405761:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965a04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672921.405773:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:2.0:1789672921.405776:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789672921.405781:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965a04 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672921.405786:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefc00/0x6c78c4f8c9965a04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672921.405855:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+27:11443:x1876607714268416:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 303us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672921.405862:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 146 00000100:00100000:3.0:1789672921.525188:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672921.525286:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714268544 00000100:00100000:1.0:1789672921.525295:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714268544 00000100:00100000:1.0:1789672921.525356:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:1.0:1789672921.525367:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714268544:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:1.0:1789672921.525402:0:8494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672921.525423:0:8494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097739a6d/0x6c78c4f8c9965a0b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd251c4 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789672921.525449:0:8494:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aac3dd3, atime: 0x6aac3dd3, ctime: 0x6aac3dd3, blocks: 0x8 00010000:00010000:1.0:1789672921.525469:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=399s v=(0 0) 00010000:00010000:1.0:1789672921.525474:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672921.525484:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097739a6d/0x6c78c4f8c9965a0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251c4 expref: 7 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672921.525505:0:8494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000097739a6d/0x6c78c4f8c9965a0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251c4 expref: 7 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672921.525520:0:8494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434e00, rc 0) 00000100:00100000:1.0:1789672921.525590:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714268544:12345-192.168.201.50@tcp:101:cat.0 Request processed in 224us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672921.525597:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:1.0:1789672921.536233:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672921.536347:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714268672 00000100:00100000:3.0:1789672921.536357:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714268672 00002000:00100000:3.0:1789672921.536421:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8cfc7d96dc00 x1876607714268672/t0(0) o3->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:547/0 lens 488/0 e 0 to 0 dl 1789672932 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789672921.536432:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfc7d96dc00 with x1876607714268672 ext(0->4095) 00002000:00010000:3.0:1789672921.536438:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfc7d96dc00 00000100:00100000:3.0:1789672921.536474:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:3.0:1789672921.536484:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714268672:12345-192.168.201.50@tcp:3:cat.0 00000100:00100000:3.0:1789672921.536804:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714268672:12345-192.168.201.50@tcp:3:cat.0 Request processed in 321us (581us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789672921.536812:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 3 00002000:00100000:3.0:1789672921.536819:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8cfc7d96dc00 x1876607714268672/t0(0) o3->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:547/0 lens 488/4536 e 0 to 0 dl 1789672932 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789672921.536827:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfc7d96dc00 with x1876607714268672 ext(0->4095) 00002000:00010000:3.0:1789672921.536831:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfc7d96dc00 00000100:00100000:2.0:1789672921.925778:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738458112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789672921.925862:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672921.926081:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738458112 00000100:00100000:3.0:1789672921.926090:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738458112 00000100:00100000:3.0:1789672921.926146:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789672921.926156:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738458112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789672921.926189:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789672921.926245:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738458112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672921.926253:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789672921.926337:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738458112:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789672922.308799:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672923.332690:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789672923.397625:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672923.397636:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789672923.397681:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789672923.397695:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789672923.460627:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672923.460675:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738458240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672923.460748:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672923.461545:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738458240 00000100:00100000:0.0:1789672923.461557:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738458240 00000100:00100000:0.0:1789672923.461633:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789672923.461645:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738458240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672923.461709:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672923.461773:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738458240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672923.461780:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789672923.461840:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738458240:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789672923.461953:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789672923.465368:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738458496:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.465441:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672923.465483:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc477d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738459008:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.465506:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672923.465528:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738459520:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.465549:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672923.465574:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789672923.465596:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738458368:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.465624:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672923.465643:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc477db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738458880:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.465703:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672923.465720:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738459392:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.465743:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672923.465772:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc477d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738458752:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.465795:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672923.465878:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc477db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738459264:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.465900:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672923.465913:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738459776:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.465930:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672923.465949:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789672923.465955:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc477d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738458624:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.465990:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672923.466008:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc477d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738459136:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466028:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672923.466040:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876607738459648:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466055:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672923.466076:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738458496 00000100:00100000:1.0:1789672923.466083:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738458496 00000100:00100000:1.0:1789672923.466117:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738459008 00000100:00100000:1.0:1789672923.466120:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738459008 00000100:00100000:1.0:1789672923.466141:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738459520 00000100:00100000:1.0:1789672923.466144:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738459520 00000100:00100000:1.0:1789672923.466157:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738458752 00000100:00100000:1.0:1789672923.466165:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738458752 00000100:00100000:1.0:1789672923.466179:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738459136 00000100:00100000:1.0:1789672923.466181:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738459136 00000100:00100000:1.0:1789672923.466203:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738459648 00000100:00100000:1.0:1789672923.466205:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738459648 00000100:00100000:1.0:1789672923.466220:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789672923.466227:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738458496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466276:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738458496:12345-0@lo:400:kworker.0 Request processed in 49us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672923.466283:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789672923.466299:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789672923.466305:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738459008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466331:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738459008:12345-0@lo:400:kworker.0 Request processed in 26us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672923.466337:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789672923.466348:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789672923.466354:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738459520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466381:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738459520:12345-0@lo:400:kworker.0 Request processed in 27us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672923.466387:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789672923.466398:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789672923.466403:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738458752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466433:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738458752:12345-0@lo:400:kworker.0 Request processed in 29us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672923.466439:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789672923.466450:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789672923.466455:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738459136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466490:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738459136:12345-0@lo:400:kworker.0 Request processed in 35us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672923.466497:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789672923.466509:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789672923.466514:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876607738459648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466539:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1876607738459648:12345-0@lo:400:kworker.0 Request processed in 26us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672923.466544:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789672923.466564:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738459392 00000100:00100000:1.0:1789672923.466567:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738459392 00000100:00100000:1.0:1789672923.466586:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738459264 00000100:00100000:1.0:1789672923.466589:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738459264 00000100:00100000:1.0:1789672923.466601:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738459776 00000100:00100000:1.0:1789672923.466603:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738459776 00000100:00100000:1.0:1789672923.466616:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789672923.466622:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876607738459392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466683:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d868a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876607738459392:12345-0@lo:400:kworker.0 Request processed in 62us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672923.466689:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789672923.466699:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789672923.466704:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738459264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466725:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738459264:12345-0@lo:400:kworker.0 Request processed in 23us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672923.466730:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789672923.466738:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789672923.466743:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738459776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466778:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738459776:12345-0@lo:400:kworker.0 Request processed in 34us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672923.466785:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:1.0:1789672923.466821:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc477d9500 x1876607738459136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672923.466834:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc477d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738459136:0@lo:400:kworker.0 00010000:00080000:1.0:1789672923.466843:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc4993ed80 x1876607738459648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672923.466851:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1876607738459648:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466860:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc477d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738458752:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466868:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc477db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738459264:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466876:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738459776:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466911:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738459392:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466920:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738458496:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466929:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc477d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738459008:0@lo:400:kworker.0 00000100:00100000:1.0:1789672923.466937:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738459520:0@lo:400:kworker.0 00000100:00100000:3.0:1789672923.474599:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738458880 00000100:00100000:3.0:1789672923.474615:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738458880 00000100:00100000:3.0:1789672923.474706:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738458624 00000100:00100000:3.0:1789672923.474710:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738458624 00000100:00100000:3.0:1789672923.474731:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789672923.474740:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738458880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672923.474853:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738458880:12345-0@lo:400:kworker.0 Request processed in 113us (9148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672923.474874:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789672923.474892:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789672923.474898:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738458624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672923.474939:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738458624:12345-0@lo:400:kworker.0 Request processed in 41us (8948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672923.474946:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:3.0:1789672923.474973:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789672923.474979:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789672923.474982:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789672923.474985:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672923.475022:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc477d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738458624:0@lo:400:kworker.0 00000100:00100000:3.0:1789672923.475058:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc477db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738458880:0@lo:400:kworker.0 00000100:00100000:3.0:1789672923.475294:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672923.475308:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738459904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789672923.475357:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672923.475368:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738458368 00000100:00100000:0.0:1789672923.475374:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738458368 00000100:00100000:0.0:1789672923.475420:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1789672923.475426:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738458368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672923.475477:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738459904 00000100:00100000:2.0:1789672923.475483:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738459904 00000100:00100000:2.0:1789672923.475514:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789672923.475522:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81a3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738459904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789672923.475537:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672923.481870:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738458368:12345-0@lo:400:kworker.0 Request processed in 6433us (16233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672923.481887:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1789672923.482008:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738458368:0@lo:400:kworker.0 00000100:00100000:2.0:1789672923.482148:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81a3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738459904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6625us (6789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672923.482167:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789672923.484693:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738459904:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1789672923.978385:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1789672923.978941:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfc430b4c00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789672923.978947:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc4545cf00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfc430b4480 00000020:00080000:0.0:1789672923.978951:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc4545c600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cfb47693c00 00000020:00080000:0.0:1789672923.978974:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1789672923.978986:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789672923.979053:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1789672923.979543:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965986 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672923.979555:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965986 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672923.979563:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965986 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672923.979580:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aef200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672923.979585:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965986 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672923.979592:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965986 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672923.979608:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8cfc4991c000) 00010000:00010000:3.0:1789672923.979611:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672923.979615:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965986 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672923.979621:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965986 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789672923.980478:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1789672923.980489:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:1.0:1789672924.355803:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789672924.997561:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789672925.001093:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672925.001117:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738460032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672925.001186:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672925.001250:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738460032 00000100:00100000:0.0:1789672925.001257:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738460032 00000100:00100000:0.0:1789672925.001311:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789672925.001321:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738460032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789672925.001349:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789672925.001395:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738460032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672925.001403:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1789672925.001436:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672925.001488:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1789672925.001495:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1789672925.001522:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738460032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672925.002161:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738460160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789672925.002197:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672925.002324:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738460160 00000100:00100000:2.0:1789672925.002330:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738460160 00000100:00100000:2.0:1789672925.002374:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789672925.002382:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738460160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789672925.002396:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789672925.002441:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738460160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672925.002447:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:0.0:1789672925.002554:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672925.002580:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738460160:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789672925.382075:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672925.921516:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672925.922180:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714268800 00000100:00100000:1.0:1789672925.922191:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714268800 00000100:00100000:1.0:1789672925.922928:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 147 00000100:00100000:1.0:1789672925.922942:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+13:11094:x1876607714268800:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1789672925.923140:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672925.923442:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+13:11094:x1876607714268800:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 Request processed in 502us (1934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672925.923450:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 147 00000100:00100000:0.0:1789672925.929450:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672925.929555:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714268928 00000100:00100000:3.0:1789672925.929712:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714268928 00000100:00100000:3.0:1789672925.929834:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 148 00000100:00100000:3.0:1789672925.929845:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:11094:x1876607714268928:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789672925.929949:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:11094:x1876607714268928:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 Request processed in 107us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672925.929956:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 148 00000100:00100000:2.0:1789672925.934964:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672925.935128:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714269184 00000100:00100000:1.0:1789672925.935138:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714269184 00000100:00100000:1.0:1789672925.935196:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:1.0:1789672925.935216:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+13:11094:x1876607714269184:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789672925.935449:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+14:11094:x1876607714269184:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 242us (493us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789672925.935457:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00080000:0.0:1789672925.937146:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789672926.019918:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738460288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672926.019999:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672926.020307:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738460288 00000100:00100000:0.0:1789672926.020316:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738460288 00000100:00100000:0.0:1789672926.020374:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789672926.020385:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738460288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789672926.020418:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789672926.024921:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738460288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4527us (4910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672926.024937:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789672926.029544:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f620380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738460288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789672926.163644:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672926.163718:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672926.163966:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714269312 00000100:00100000:2.0:1789672926.164089:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672926.164141:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672926.164188:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714269824 00000100:00100000:0.0:1789672926.164198:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714269824 00000100:00100000:0.0:1789672926.164263:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 321 00000100:00100000:0.0:1789672926.164274:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714269824:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672926.164347:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714269824:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 75us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672926.164355:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 321 00000100:00080000:0.0:1789672926.164384:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789672926.168848:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672926.169262:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714269312 00000100:00100000:1.0:1789672926.169280:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714269696 00000100:00100000:1.0:1789672926.169283:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714269696 00000100:00100000:1.0:1789672926.169416:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 322 00000100:00100000:1.0:1789672926.169429:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714269696:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672926.169508:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714269696:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 83us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672926.169516:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 322 00000100:00100000:1.0:1789672926.169697:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 390 00000100:00100000:1.0:1789672926.169705:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2398:x1876607714269312:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672926.169810:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2398:x1876607714269312:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 105us (6176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672926.169817:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 390 00000100:00080000:2.0:1789672926.171440:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672926.171562:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714269568 00000100:00100000:3.0:1789672926.171574:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714269568 00000100:00100000:3.0:1789672926.171674:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714269440 00000100:00100000:3.0:1789672926.171678:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714269440 00000100:00100000:3.0:1789672926.171719:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 114 00000100:00100000:3.0:1789672926.171730:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f621880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714269568:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672926.171810:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f621880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2398:x1876607714269568:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 82us (8091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672926.171818:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 114 00000100:00100000:3.0:1789672926.171834:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 115 00000100:00100000:3.0:1789672926.171842:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714269440:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672926.171879:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2398:x1876607714269440:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 38us (7737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672926.171885:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 115 00000100:00080000:2.0:1789672926.172086:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789672926.172090:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789672926.403850:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672927.051246:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672927.051271:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738460416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789672927.051340:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672927.051457:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738460416 00000100:00100000:1.0:1789672927.051466:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738460416 00000100:00100000:1.0:1789672927.051521:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789672927.051531:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738460416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789672927.051564:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789672927.051639:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738460416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672927.051646:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789672927.051696:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48231c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738460416:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789672927.427937:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789672927.892237:0:14506:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 15:22:05 (1789672925) 00010000:00010000:0.0:1789672928.451920:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672928.581229:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738460672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672928.581305:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738460928:0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.581309:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672928.581338:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672928.581381:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738461184:0@lo:400:kworker.0 00000100:00100000:1.0:1789672928.581396:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738460544:0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.581402:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672928.581419:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738461696:0@lo:400:kworker.0 00000100:00100000:1.0:1789672928.581426:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672928.581447:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738461056:0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.581455:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672928.581467:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672928.581468:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738462208:0@lo:400:kworker.0 00000100:00100000:1.0:1789672928.581483:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738461568:0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.581484:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672928.581499:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672928.581500:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789672928.581506:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738460800:0@lo:400:kworker.0 00000100:00100000:1.0:1789672928.581511:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738462080:0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.581524:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672928.581525:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672928.581537:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738461312:0@lo:400:kworker.0 00000100:00100000:1.0:1789672928.581552:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738461056 00000100:00100000:0.0:1789672928.581568:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672928.581585:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738461824:0@lo:400:kworker.0 00000100:00100000:1.0:1789672928.581591:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738461056 00000100:00100000:0.0:1789672928.581602:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672928.581630:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738460800 00000100:00100000:1.0:1789672928.581633:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738460800 00000100:00100000:1.0:1789672928.581646:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738461312 00000100:00100000:1.0:1789672928.581648:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738461312 00000100:00100000:1.0:1789672928.581694:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738461824 00000100:00100000:1.0:1789672928.581698:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738461824 00000100:00100000:1.0:1789672928.581714:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789672928.581722:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738461056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672928.581772:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738461056:12345-0@lo:400:kworker.0 Request processed in 50us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672928.581780:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789672928.581797:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789672928.581804:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738460800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.581817:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738460672 00000100:00100000:0.0:1789672928.581820:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738460672 00000100:00100000:1.0:1789672928.581836:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738460800:12345-0@lo:400:kworker.0 Request processed in 34us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672928.581842:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789672928.581847:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789672928.581852:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789672928.581854:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738460672:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672928.581856:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738461312:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789672928.581874:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672928.581878:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738461312:12345-0@lo:400:kworker.0 Request processed in 23us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672928.581883:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789672928.581892:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789672928.581897:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738461824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.581902:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738460672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672928.581908:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789672928.581918:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738461824:12345-0@lo:400:kworker.0 Request processed in 21us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672928.581923:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789672928.581925:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738460928 00000100:00100000:0.0:1789672928.581928:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738460928 00000100:00100000:1.0:1789672928.581937:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738461696 00000100:00100000:1.0:1789672928.581940:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738461696 00000100:00100000:0.0:1789672928.581949:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738461184 00000100:00100000:0.0:1789672928.581951:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738461184 00000100:00100000:1.0:1789672928.581956:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738462208 00000100:00100000:1.0:1789672928.581958:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738462208 00000100:00100000:0.0:1789672928.581963:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789672928.581965:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738461568 00000100:00100000:0.0:1789672928.581968:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4793b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738460928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672928.581973:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738461568 00000100:00100000:1.0:1789672928.581986:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738462080 00000100:00100000:1.0:1789672928.581988:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738462080 00000100:00100000:0.0:1789672928.581998:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4793b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738460928:12345-0@lo:400:kworker.0 Request processed in 29us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672928.582000:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789672928.582006:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738461696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.582013:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789672928.582024:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789672928.582030:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738461184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672928.582031:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48230700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738461696:12345-0@lo:400:kworker.0 Request processed in 26us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672928.582036:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789672928.582044:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789672928.582050:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738462208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.582054:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738461184:12345-0@lo:400:kworker.0 Request processed in 25us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672928.582059:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789672928.582069:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738462208:12345-0@lo:400:kworker.0 Request processed in 20us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672928.582074:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789672928.582079:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738460544 00000100:00100000:1.0:1789672928.582081:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789672928.582082:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738460544 00000100:00100000:1.0:1789672928.582086:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738461568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.582103:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1789672928.582109:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738460544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672928.582110:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738461568:12345-0@lo:400:kworker.0 Request processed in 24us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672928.582115:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789672928.582124:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789672928.582129:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738462080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.582133:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738460544:12345-0@lo:400:kworker.0 Request processed in 25us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672928.582138:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789672928.582149:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738462080:12345-0@lo:400:kworker.0 Request processed in 20us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672928.582154:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789672928.582186:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f622680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738460544:0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.582192:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738460800:0@lo:400:kworker.0 00000100:00100000:1.0:1789672928.582196:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738461056:0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.582200:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738461312:0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.582207:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738461824:0@lo:400:kworker.0 00000100:00100000:1.0:1789672928.582212:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738461568:0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.582214:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738461184:0@lo:400:kworker.0 00000100:00100000:1.0:1789672928.582220:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738462080:0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.582221:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738461696:0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.582228:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738462208:0@lo:400:kworker.0 00000100:00100000:0.0:1789672928.582239:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738460672:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789672928.582267:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672928.582270:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789672928.582273:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672928.583164:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738460928:0@lo:400:kworker.0 00000100:00100000:2.0:1789672928.583175:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876607738461440:0@lo:400:kworker.0 00000100:00100000:2.0:1789672928.583211:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672928.583240:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738461952:0@lo:400:kworker.0 00000100:00100000:2.0:1789672928.583261:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672928.583420:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738461440 00000100:00100000:1.0:1789672928.583426:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738461440 00000100:00100000:1.0:1789672928.583471:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738461952 00000100:00100000:1.0:1789672928.583474:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738461952 00000100:00100000:1.0:1789672928.583493:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789672928.583500:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876607738461440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672928.583542:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876607738461440:12345-0@lo:400:kworker.0 Request processed in 43us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672928.583549:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789672928.583573:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789672928.583579:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738461952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672928.583604:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738461952:12345-0@lo:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672928.583609:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00080000:2.0:1789672928.586103:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789672928.586160:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8dc000 x1876607738461440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672928.586179:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876607738461440:0@lo:400:kworker.0 00010000:00080000:2.0:1789672928.586193:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d86ca80 x1876607738461952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672928.586202:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738461952:0@lo:400:kworker.0 00000100:00100000:3.0:1789672928.587793:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672928.587812:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738462336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789672928.587884:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672928.589564:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738462336 00000100:00100000:0.0:1789672928.589576:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738462336 00000100:00100000:0.0:1789672928.590362:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789672928.590375:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738462336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789672928.590404:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672928.590542:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738462336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 170us (2666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672928.590550:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789672928.607902:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738462336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789672929.212050:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672929.212114:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714270080 00000100:00100000:2.0:1789672929.212124:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714270080 00000100:00100000:2.0:1789672929.212246:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 149 00000100:00100000:2.0:1789672929.212257:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+14:12162:x1876607714270080:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672929.212295:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672929.212317:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965a12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd251cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212386:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965a19 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212399:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965a19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212412:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965a19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212425:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965a20 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212432:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965a20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212439:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965a20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212526:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c9965a27 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212573:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c9965a27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212581:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c9965a27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672929.212592:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789672929.212719:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965a19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212727:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965a19 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212734:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965a19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212741:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aee200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672929.212745:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965a19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212753:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965a19 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212774:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cfc61501400) 00010000:00010000:2.0:1789672929.212777:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672929.212782:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965a19 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212788:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965a19 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212802:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965a20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212808:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965a20 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212813:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965a20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212828:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aef200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672929.212830:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965a20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212836:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965a20 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212844:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cfc4991c300) 00010000:00010000:2.0:1789672929.212847:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672929.212850:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965a20 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.212856:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965a20 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.213716:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965a12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251cb expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.213736:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c9965a27 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251cb expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672929.213743:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfc61501100) 00010000:00010000:2.0:1789672929.213745:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672929.213748:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee600, rc 0) 00000100:00100000:2.0:1789672929.213814:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+16:12162:x1876607714270080:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 1559us (1771us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789672929.213822:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 149 00000100:00080000:1.0:1789672929.214679:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789672929.216613:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:0.0:1789672929.216632:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1789672929.216786:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1789672929.216806:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789672929.233155:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672929.233238:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672929.233297:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714270336 00000100:00100000:3.0:1789672929.233309:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714270336 00000100:00100000:0.0:1789672929.233378:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714270208 00000100:00100000:0.0:1789672929.233382:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714270208 00000100:00100000:3.0:1789672929.233457:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:3.0:1789672929.233469:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+15:2397:x1876607714270336:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672929.233485:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672929.233510:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c9965a27 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251cb expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672929.233557:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfc61501100) 00010000:00010000:3.0:1789672929.233563:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672929.233631:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+14:2397:x1876607714270336:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 164us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672929.233638:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:0.0:1789672929.233756:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 150 00000100:00100000:0.0:1789672929.234217:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+13:12162:x1876607714270208:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789672929.234310:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+13:12162:x1876607714270208:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 Request processed in 546us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672929.234317:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 150 00000100:00100000:2.0:1789672929.240480:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672929.240633:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714270464 00000100:00100000:0.0:1789672929.240644:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714270464 00000100:00100000:0.0:1789672929.240756:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 151 00000100:00080000:1.0:1789672929.240766:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789672929.240768:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:12162:x1876607714270464:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789672929.240988:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:12162:x1876607714270464:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 Request processed in 222us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672929.240995:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 151 00010000:00010000:2.0:1789672929.475892:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789672929.539965:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789672929.539974:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789672929.543558:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789672929.543576:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789672930.116024:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4824ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738462464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672930.116099:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672930.116192:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738462464 00000100:00100000:3.0:1789672930.116200:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738462464 00000100:00100000:3.0:1789672930.116262:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789672930.116272:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738462464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672930.116300:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789672930.116429:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738462592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789672930.116468:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789672930.116515:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789672930.117084:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789672930.119274:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738462592 00000100:00100000:2.0:1789672930.119287:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738462592 00000100:00100000:2.0:1789672930.119347:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789672930.119356:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738462592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789672930.119444:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789672930.119523:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738462592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 168us (3054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672930.119544:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1789672930.119568:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672930.119609:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738462592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789672930.120825:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738462464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4549us (4719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672930.120836:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789672930.121632:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4824ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738462464:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789672930.512728:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672931.143731:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789672931.143755:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738462720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672931.143827:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672931.143896:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738462720 00000100:00100000:1.0:1789672931.143905:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738462720 00000100:00100000:1.0:1789672931.143955:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789672931.143965:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738462720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789672931.144001:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789672931.144049:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738462720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672931.144057:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789672931.144106:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738462720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672931.285072:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672931.286060:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714270592 00000100:00100000:0.0:1789672931.286074:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714270592 00000100:00100000:0.0:1789672931.286124:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 392 00000100:00100000:0.0:1789672931.286133:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714270592:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672931.286213:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714270592:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 81us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672931.286221:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 392 00000100:00100000:2.0:1789672931.292111:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672931.293169:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714270720 00000100:00100000:1.0:1789672931.293181:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714270720 00000100:00100000:1.0:1789672931.293340:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 329 00000100:00100000:1.0:1789672931.293351:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+13:2397:x1876607714270720:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672931.293627:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+13:2397:x1876607714270720:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 277us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672931.293636:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 329 00000100:00080000:3.0:1789672931.295976:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672931.300706:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672931.300761:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672931.300815:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714270976 00000100:00100000:3.0:1789672931.300826:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714270976 00000100:00100000:3.0:1789672931.300905:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00100000:3.0:1789672931.300916:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2397:x1876607714270976:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672931.300981:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2397:x1876607714270976:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 67us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672931.300986:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672931.300995:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00100000:3.0:1789672931.301013:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714271104 00000100:00100000:3.0:1789672931.301017:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714271104 00000100:00100000:2.0:1789672931.301022:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672931.301054:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 121 00000100:00100000:2.0:1789672931.301055:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672931.301066:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714271104:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672931.301087:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672931.301115:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714270848 00000100:00100000:3.0:1789672931.301117:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714271104:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 52us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672931.301120:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714270848 00000100:00100000:3.0:1789672931.301128:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 121 00000100:00100000:2.0:1789672931.301154:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714271232 00000100:00100000:3.0:1789672931.301158:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714271360 00000100:00100000:2.0:1789672931.301158:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714271232 00000100:00100000:3.0:1789672931.301164:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714271360 00000100:00100000:2.0:1789672931.301176:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714271488 00000100:00100000:2.0:1789672931.301181:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714271488 00000100:00100000:3.0:1789672931.301192:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 330 00000100:00100000:3.0:1789672931.301201:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714270848:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672931.301216:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 331 00000100:00100000:2.0:1789672931.301226:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714271232:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672931.301233:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714270848:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 31us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672931.301240:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 330 00000100:00100000:3.0:1789672931.301257:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 332 00000100:00100000:3.0:1789672931.301265:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714271360:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672931.301289:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714271360:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 26us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672931.301295:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 332 00000100:00100000:3.0:1789672931.301306:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 152 00000100:00100000:3.0:1789672931.301311:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+13:12205:x1876607714271488:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789672931.301321:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672931.301340:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965a35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd251d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672931.301380:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2398:x1876607714271232:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 154us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672931.301387:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 331 00010000:00010000:3.0:1789672931.301398:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301425:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301453:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301469:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965a43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301477:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965a43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301483:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965a43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301537:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301545:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301552:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301557:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672931.301561:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301569:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301580:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfb46b95c00) 00010000:00010000:3.0:1789672931.301584:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672931.301588:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301600:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301613:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965a43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301619:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965a43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301624:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965a43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301629:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672931.301632:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965a43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301638:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965a43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301645:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cfb419b1b00) 00010000:00010000:3.0:1789672931.301647:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672931.301650:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965a43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789672931.301821:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789672931.301826:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789672931.301829:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789672931.301831:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789672931.301953:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965a43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.301987:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965a35 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251d2 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.302008:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfb46b95c00) 00010000:00010000:3.0:1789672931.302010:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672931.302015:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965a35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251d2 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.302024:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886000, rc 0) 00000100:00100000:3.0:1789672931.302045:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+13:12205:x1876607714271488:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 734us (962us total) trans 0 rc 301/301 00000100:00100000:3.0:1789672931.302051:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 152 00000100:00100000:3.0:1789672931.318774:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672931.321919:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714271744 00000100:00100000:2.0:1789672931.321934:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714271744 00000100:00100000:2.0:1789672931.322010:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 153 00000100:00100000:2.0:1789672931.322021:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+13:12205:x1876607714271744:12345-192.168.201.50@tcp:36:lfs.0 00010000:00010000:2.0:1789672931.322078:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672931.322104:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9965397 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ffd expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.322121:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfb46b95c00) 00010000:00010000:2.0:1789672931.322130:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672931.322184:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965a4a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.322194:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965a4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.322201:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965a4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.322208:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965a51 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.322225:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965a51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.322229:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965a51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.323047:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965a58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.323061:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965a58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.323070:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965a58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672931.323086:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d9ae702 reply state 00000000cd1ee4e8 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965a58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.323096:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965a58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.323102:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:3.0:1789672931.323105:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789672931.323108:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789672931.323118:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789672931.323126:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965a4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.323133:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965a4a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.323141:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965a4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.323146:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aeec00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672931.323151:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965a4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.323158:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965a4a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.323166:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc4991c300) 00010000:00010000:3.0:1789672931.323168:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672931.323171:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965a4a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.323177:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965a4a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672931.323191:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d9ae702 reply state 00000000cd1ee4e8 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965a51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.323198:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965a51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.323204:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cfc4991c400) 00010000:00010000:3.0:1789672931.323206:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789672931.323211:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789672931.324414:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+14:12205:x1876607714271744:12345-192.168.201.50@tcp:36:lfs.0 Request processed in 2387us (5640us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789672931.324424:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 153 00000100:00100000:0.0:1789672931.430575:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672931.430690:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714271872 00000100:00100000:2.0:1789672931.430701:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714271872 00000100:00100000:2.0:1789672931.430763:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 154 00000100:00100000:2.0:1789672931.430774:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+14:12213:x1876607714271872:12345-192.168.201.50@tcp:101:lctl.0 00010000:00010000:2.0:1789672931.430799:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672931.430826:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9965a5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd251d9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.430910:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee400/0x6c78c4f8c9965a66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.430926:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee400/0x6c78c4f8c9965a66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.430939:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee400/0x6c78c4f8c9965a66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672931.430988:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789672931.430992:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789672931.431014:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee400/0x6c78c4f8c9965a66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.431042:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9965a5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251d9 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.431083:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee400/0x6c78c4f8c9965a66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251d9 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.431092:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc4991c100) 00010000:00010000:2.0:1789672931.431095:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789672931.431098:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee400, rc 0) 00000100:00100000:2.0:1789672931.431176:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+15:12213:x1876607714271872:12345-192.168.201.50@tcp:101:lctl.0 Request processed in 402us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672931.431184:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 154 00000100:00100000:2.0:1789672931.475980:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672931.479584:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714272000 00000100:00100000:1.0:1789672931.479600:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714272000 00000100:00100000:1.0:1789672931.480320:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 155 00000100:00100000:1.0:1789672931.480334:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+15:12219:x1876607714272000:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789672931.480356:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672931.480379:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965a6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd251e0 expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.480520:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965a74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.480537:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965a74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.480549:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965a74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.480561:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965a7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.480568:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965a7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.480574:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965a7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481120:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965a82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481131:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965a82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481139:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965a82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672931.481194:0:11081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789672931.481199:0:11081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789672931.481219:0:11081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965a82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481231:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965a74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481237:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965a74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481244:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965a74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481250:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672931.481255:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965a74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481262:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965a74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481274:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc4991c100) 00010000:00010000:1.0:1789672931.481278:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672931.481284:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965a74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481290:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965a74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481303:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965a7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481320:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965a7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481326:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965a7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481332:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672931.481335:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965a7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481341:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965a7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481350:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cfc4991c400) 00010000:00010000:1.0:1789672931.481353:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672931.481356:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965a7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481362:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965a7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481389:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965a6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251e0 expref: 17 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481402:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965a82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251e0 expref: 16 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.481410:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:1.0:1789672931.481412:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789672931.482181:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434800, rc 0) 00000100:00100000:1.0:1789672931.482267:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+16:12219:x1876607714272000:12345-192.168.201.50@tcp:101:bash.0 Request processed in 1936us (6297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672931.482276:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 155 00000100:00100000:0.0:1789672931.489267:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672931.490280:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714272256 00000100:00100000:3.0:1789672931.490367:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714272256 00000100:00100000:3.0:1789672931.490428:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 156 00000100:00100000:3.0:1789672931.490438:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+16:12219:x1876607714272256:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789672931.490459:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672931.490823:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965a89 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd251e7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.496755:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a90 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.496784:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.496798:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.496863:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965a97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.496872:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965a97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.496880:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965a97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789672931.499199:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789672931.499412:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965a9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.499429:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.499442:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.501948:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.501966:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a90 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.501974:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.501980:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672931.501984:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.501992:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a90 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.502008:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:3.0:1789672931.502011:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672931.502016:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a90 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.502023:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965a90 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672931.502061:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8033374 reply state 00000000ca0f74f2 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965a97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.502074:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965a97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.502082:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb419b1f00) 00010000:00010000:3.0:1789672931.502084:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789672931.502088:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789672931.502144:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9965a89 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251e7 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.502161:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251e7 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.502169:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfb419b1200) 00010000:00010000:3.0:1789672931.502171:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672931.502174:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886800, rc 0) 00000100:00100000:3.0:1789672931.502784:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:12219:x1876607714272256:12345-192.168.201.50@tcp:101:bash.0 Request processed in 12343us (13524us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789672931.502794:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 156 00010000:00010000:0.0:1789672931.524127:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672931.527163:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672931.527273:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714272384 00000100:00100000:2.0:1789672931.527283:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714272384 00000100:00100000:2.0:1789672931.527355:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:2.0:1789672931.527365:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714272384:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789672931.527385:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672931.527407:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001c6f97c/0x6c78c4f8c9965aac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd251ee expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789672931.527435:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789672931.527453:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=409s v=(0 0) 00010000:00010000:2.0:1789672931.527458:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672931.527467:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001c6f97c/0x6c78c4f8c9965aac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251ee expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.527485:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001c6f97c/0x6c78c4f8c9965aac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251ee expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.527525:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef800, rc 0) 00000100:00100000:2.0:1789672931.527598:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2396:x1876607714272384:12345-192.168.201.50@tcp:101:bash.0 Request processed in 234us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672931.527605:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:2.0:1789672931.538447:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672931.538863:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714272512 00000100:00100000:3.0:1789672931.538875:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714272512 00000100:00100000:3.0:1789672931.538950:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:3.0:1789672931.538962:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:12219:x1876607714272512:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789672931.538983:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672931.539003:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd251f5 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.539052:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001c6f97c/0x6c78c4f8c9965aac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251ee expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.539062:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672931.539066:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672931.539071:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251f5 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.539177:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001c6f97c/0x6c78c4f8c9965aac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251ee expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.539192:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001c6f97c/0x6c78c4f8c9965aac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251ee expref: 7 pid: 8429 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672931.539207:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4824ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1876607738462848:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672931.539325:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789672931.543348:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4824ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8430:1876607738462848:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789672931.543389:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251f5 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.543420:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887200, rc 0) 00000100:00100000:3.0:1789672931.543779:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f602680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:12219:x1876607714272512:12345-192.168.201.50@tcp:101:bash.0 Request processed in 4528us (5049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672931.543788:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:1.0:1789672931.548877:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672931.549038:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714272640 00000100:00100000:0.0:1789672931.549049:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714272640 00010000:00010000:0.0:1789672931.549103:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001c6f97c/0x6c78c4f8c9965aac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251ee expref: 7 pid: 8429 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672931.549147:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 81 00000100:00100000:0.0:1789672931.549158:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2395:x1876607714272640:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672931.549173:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672931.549195:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001c6f97c/0x6c78c4f8c9965aac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251ee expref: 7 pid: 8429 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672931.549219:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001c6f97c/0x6c78c4f8c9965aac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251ee expref: 7 pid: 8429 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672931.549243:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001c6f97c/0x6c78c4f8c9965aac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251ee expref: 7 pid: 8429 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672931.549276:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672931.549281:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672931.549291:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251f5 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672931.549302:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251f5 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672931.549344:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251f5 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672931.549359:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47b80e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6498:1876607738462976:192.168.201.50@tcp:105: 00000100:00100000:0.0:1789672931.549452:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d805000 going to sleep for 11 seconds 00000100:00100000:2.0:1789672931.555116:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672931.555438:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714272896 00000100:00100000:1.0:1789672931.555448:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714272896 00000100:00100000:1.0:1789672931.555532:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:1.0:1789672931.555545:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:12219:x1876607714272896:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:1.0:1789672931.555864:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:12219:x1876607714272896:12345-192.168.201.50@tcp:35:bash.0 Request processed in 321us (759us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789672931.555872:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:0.0:1789672931.556853:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47b80e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6498:1876607738462976:192.168.201.50@tcp:105: 00010000:00010000:0.0:1789672931.556879:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672931.556960:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2395:x1876607714272640:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 7804us (8092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672931.556970:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 81 00000100:00100000:2.0:1789672931.683266:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672931.683436:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714273152 00000100:00100000:3.0:1789672931.683446:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714273152 00000100:00100000:3.0:1789672931.683623:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 157 00000100:00100000:3.0:1789672931.683635:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:12229:x1876607714273152:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789672931.683849:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672931.683871:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965aba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd251fc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672931.683970:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789672931.684068:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965aba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251fc expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.684081:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc4991c100) 00010000:00010000:3.0:1789672931.684084:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789672931.684089:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965aba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251fc expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.684104:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886c00, rc 0) 00000100:00100000:3.0:1789672931.684207:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:12229:x1876607714273152:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 575us (950us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1789672931.684214:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 157 00000100:00100000:1.0:1789672931.688615:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672931.689362:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714273408 00000100:00100000:3.0:1789672931.689374:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714273408 00000100:00100000:3.0:1789672931.689789:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 37 00000100:00100000:3.0:1789672931.689802:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:12229:x1876607714273408:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789672931.690050:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:12229:x1876607714273408:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 251us (1446us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789672931.690076:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 37 00000100:00100000:1.0:1789672931.833244:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672931.836262:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714273536 00000100:00100000:3.0:1789672931.836279:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714273536 00000100:00100000:3.0:1789672931.836353:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 158 00000100:00100000:3.0:1789672931.836365:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:12235:x1876607714273536:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789672931.836392:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672931.836412:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965ac8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25203 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.836516:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4400/0x6c78c4f8c9965acf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.836641:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4400/0x6c78c4f8c9965acf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.836654:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4400/0x6c78c4f8c9965acf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672931.836790:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789672931.836795:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789672931.836815:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4400/0x6c78c4f8c9965acf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.836845:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9965ac8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25203 expref: 24 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.836866:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4400/0x6c78c4f8c9965acf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25203 expref: 23 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.836888:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:3.0:1789672931.836891:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789672931.836895:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e4400, rc 0) 00000100:00100000:3.0:1789672931.837137:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+23:12235:x1876607714273536:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 772us (3901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672931.837144:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 158 00000100:00100000:1.0:1789672931.843172:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672931.843275:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714273792 00000100:00100000:3.0:1789672931.843287:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714273792 00000100:00100000:3.0:1789672931.843349:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 159 00000100:00100000:3.0:1789672931.843360:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+23:12235:x1876607714273792:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789672931.843381:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672931.843401:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965ad6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2520a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.843525:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965add lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.843539:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965add lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.843551:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965add lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672931.843562:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789672931.843698:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965ad6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2520a expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.843726:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965add lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2520a expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.843733:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfb419b1200) 00010000:00010000:3.0:1789672931.843735:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672931.843738:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e5400, rc 0) 00000100:00100000:3.0:1789672931.843799:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:12235:x1876607714273792:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 441us (637us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1789672931.843805:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 159 00000100:00100000:1.0:1789672931.848117:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672931.848624:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714273920 00000100:00100000:3.0:1789672931.848643:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714273920 00000100:00100000:3.0:1789672931.848749:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:3.0:1789672931.848758:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:2397:x1876607714273920:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672931.848776:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672931.848799:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965add lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2520a expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.848819:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfb419b1200) 00010000:00010000:3.0:1789672931.848824:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672931.848878:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+24:2397:x1876607714273920:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 121us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672931.848885:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:2.0:1789672931.854141:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672931.854266:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714274176 00000100:00100000:3.0:1789672931.854277:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714274176 00000100:00100000:3.0:1789672931.854341:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 160 00000100:00100000:3.0:1789672931.854366:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+24:12235:x1876607714274176:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789672931.854389:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672931.854407:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9965aeb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25211 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.854530:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965af2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.854545:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965af2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.854557:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965af2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672931.854570:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789672931.854798:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9965aeb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25211 expref: 27 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.854818:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965af2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25211 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.854827:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfb419b1200) 00010000:00010000:3.0:1789672931.854831:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789672931.854834:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e4000, rc 0) 00000100:00100000:3.0:1789672931.854895:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+26:12235:x1876607714274176:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 532us (764us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1789672931.854903:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 160 00000100:00100000:1.0:1789672931.860105:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672931.860201:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714274304 00000100:00100000:2.0:1789672931.860212:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714274304 00000100:00100000:2.0:1789672931.860280:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:2.0:1789672931.860291:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2395:x1876607714274304:12345-192.168.201.50@tcp:1:lfs.0 00010000:00010000:2.0:1789672931.860335:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c08e126/0x6c78c4f8c9965b00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.860356:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251f5 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.860362:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672931.860365:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789672931.860368:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c08e126/0x6c78c4f8c9965b00 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.860397:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251f5 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.860425:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251f5 expref: 6 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672931.860440:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8429:1876607738463104:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789672931.860542:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc430b4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789672931.866437:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8429:1876607738463104:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789672931.867800:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001c08e126/0x6c78c4f8c9965b00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672931.869541:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672931.870155:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714274432 00000100:00100000:3.0:1789672931.870167:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714274432 00002000:00100000:0.0:1789672931.870327:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8cfb48355180 x1876607714274432/t0(0) o4->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:557/0 lens 504/0 e 0 to 0 dl 1789672942 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789672931.870339:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfb48355180 with x1876607714274432 ext(0->12) 00010000:00010000:0.0:1789672931.870349:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251f5 expref: 7 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672931.870379:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251f5 expref: 7 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789672931.870388:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cfb48355180 00000100:00100000:0.0:1789672931.871086:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:0.0:1789672931.871097:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714274432:12345-192.168.201.50@tcp:4:lfs.0 00000100:00100000:0.0:1789672931.872068:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2396:x1876607714274432:12345-192.168.201.50@tcp:4:lfs.0 Request processed in 970us (2536us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789672931.872079:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 2 00002000:00100000:0.0:1789672931.872089:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8cfb48355180 x1876607714274432/t4294967306(0) o4->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:557/0 lens 504/448 e 0 to 0 dl 1789672942 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789672931.872099:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfb48355180 with x1876607714274432 ext(0->12) 00010000:00010000:0.0:1789672931.872108:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251f5 expref: 9 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672931.872123:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251f5 expref: 9 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789672931.872132:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cfb48355180 00000100:00100000:1.0:1789672931.877268:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672931.878178:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714274560 00000100:00100000:3.0:1789672931.878360:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714274560 00010000:00010000:3.0:1789672931.878406:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251f5 expref: 9 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672931.878547:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 82 00000100:00100000:3.0:1789672931.878558:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48354380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2398:x1876607714274560:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672931.878574:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789672931.878602:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789672931.878605:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789672930 00002000:00010000:3.0:1789672931.878608:0:6497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789672930 00002000:00010000:3.0:1789672931.878610:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789672930 00002000:00010000:3.0:1789672931.878612:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789672931.878618:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251f5 expref: 9 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.878633:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251f5 expref: 9 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.878688:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c9965ab3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251f5 expref: 9 pid: 8430 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.878705:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672931.878709:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672931.878715:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001c08e126/0x6c78c4f8c9965b00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.878744:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c08e126/0x6c78c4f8c9965b00 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672931.878778:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672931.878842:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48354380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2398:x1876607714274560:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 285us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672931.878850:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 82 00010000:00010000:2.0:1789672931.879106:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001c08e126/0x6c78c4f8c9965b00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.879117:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c08e126/0x6c78c4f8c9965b00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.879138:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c08e126/0x6c78c4f8c9965b00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.879147:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c08e126/0x6c78c4f8c9965b00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.879154:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c08e126/0x6c78c4f8c9965b00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.879172:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aefc00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789672931.879176:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c08e126/0x6c78c4f8c9965b00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.879184:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c08e126/0x6c78c4f8c9965b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.879210:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c08e126/0x6c78c4f8c9965b00 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.879218:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c08e126/0x6c78c4f8c9965b00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672931.879282:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2395:x1876607714274304:12345-192.168.201.50@tcp:1:lfs.0 Request processed in 18992us (19185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672931.879290:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:1.0:1789672931.884330:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672931.884427:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714274816 00000100:00100000:2.0:1789672931.884438:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714274816 00000100:00100000:2.0:1789672931.884519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 38 00000100:00100000:2.0:1789672931.884529:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f853050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+26:12235:x1876607714274816:12345-192.168.201.50@tcp:35:lfs.0 00000004:00010000:2.0:1789672931.884589:0:6516:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965af2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25211 expref: 26 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789672931.884836:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1789672931.884868:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789672931.885368:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1789672931.885408:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965b07 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.885424:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965a9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251e7 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.885433:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965b07 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.885466:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251e7 expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.885481:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965a9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251e7 expref: 30 pid: 6512 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672931.885494:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1876607738463232:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789672931.885585:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc430b4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789672931.890003:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6516:1876607738463232:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789672931.890036:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965b07 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672931.890626:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672931.891980:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714274944 00000100:00100000:0.0:1789672931.891995:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714274944 00010000:00010000:0.0:1789672931.892055:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965a9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251e7 expref: 31 pid: 6512 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672931.892125:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 83 00000100:00100000:2.0:1789672931.892137:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+31:2396:x1876607714274944:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672931.892154:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672931.892162:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965a9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251e7 expref: 31 pid: 6512 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.892188:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251e7 expref: 31 pid: 6512 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.892224:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c9965a9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251e7 expref: 31 pid: 6512 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.892240:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfb419b1200) 00010000:00010000:2.0:1789672931.892246:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965b07 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.892255:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965b07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.892263:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965b07 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.892296:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672931.892361:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+30:2396:x1876607714274944:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 226us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672931.892368:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 83 00010000:00010000:1.0:1789672931.892605:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965b07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.892627:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965b07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789672931.892780:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1789672931.893035:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1789672931.893121:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876607738463360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789672931.893187:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672931.893229:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4a537600 going to sleep for 11 seconds 00000100:00100000:2.0:1789672931.893321:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738463360 00000100:00100000:2.0:1789672931.893328:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738463360 00000100:00100000:2.0:1789672931.893385:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789672931.893393:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1876607738463360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789672931.894535:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1876607738463360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1139us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672931.894546:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789672931.894926:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876607738463360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789672931.895176:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1789672931.895294:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876607738463488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789672931.895384:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672931.895431:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb419de600 going to sleep for 11 seconds 00000100:00100000:1.0:1789672931.895508:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738463488 00000100:00100000:1.0:1789672931.895515:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738463488 00000100:00100000:1.0:1789672931.895576:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789672931.895585:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6516:x1876607738463488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789672931.896431:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6516:x1876607738463488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 832us (1031us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789672931.896450:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789672931.896508:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6516:1876607738463488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789672931.896554:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1789672931.896586:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965b07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.896619:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965b07 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.896849:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965b07 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.896858:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aef800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672931.896872:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965b07 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.896880:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965b07 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.896893:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfb419b1200) 00010000:00010000:1.0:1789672931.896896:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789672931.896900:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965b07 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672931.896907:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965b07 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789672931.897248:0:6516:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789672931.897345:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1789672931.897370:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 409812710687ns, next at 410812708292ns, rc = 0 00000001:00080000:1.0:1789672931.897377:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1789672931.897431:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfb419b1200) 00010000:00010000:1.0:1789672931.897434:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789672931.897441:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965af2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25211 expref: 34 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789672931.897547:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789672931.898060:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f853050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+33:12235:x1876607714274816:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 13531us (13739us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1789672931.898069:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 38 00000020:00080000:1.0:1789672931.898074:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789672931.909647:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672931.910718:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714275072 00000100:00100000:2.0:1789672931.910730:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714275072 00000100:00100000:2.0:1789672931.910791:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 161 00000100:00100000:2.0:1789672931.910802:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+33:12235:x1876607714275072:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789672931.910831:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672931.910856:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965b0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25218 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.910920:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965b0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25218 expref: 34 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.910936:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965b0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25218 expref: 34 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672931.910956:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:2.0:1789672931.910960:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789672931.910963:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aefe00, rc 0) 00000100:00100000:2.0:1789672931.911026:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+34:12235:x1876607714275072:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 226us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672931.911033:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 161 00000100:00100000:2.0:1789672931.917036:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672931.919237:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714275328 00000100:00100000:1.0:1789672931.919254:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714275328 00000100:00100000:1.0:1789672931.919350:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:1.0:1789672931.919362:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+34:12235:x1876607714275328:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:1.0:1789672931.919625:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+35:12235:x1876607714275328:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 265us (2598us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1789672931.919633:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:1.0:1789672932.073393:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672932.074265:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714275584 00000100:00100000:0.0:1789672932.074276:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714275584 00000100:00100000:0.0:1789672932.074382:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 162 00000100:00100000:0.0:1789672932.074392:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+35:12245:x1876607714275584:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789672932.074418:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672932.074437:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965b15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2521f expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672932.074620:0:11081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789672932.074883:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965b15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2521f expref: 37 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672932.074899:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc4991c100) 00010000:00010000:0.0:1789672932.074902:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789672932.074908:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965b15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2521f expref: 37 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672932.074921:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cd600, rc 0) 00000100:00100000:0.0:1789672932.074986:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+36:12245:x1876607714275584:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 596us (1603us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1789672932.074994:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 162 00000100:00100000:0.0:1789672932.079053:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672932.079161:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714275712 00000100:00100000:3.0:1789672932.079170:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714275712 00000100:00100000:3.0:1789672932.079239:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 163 00000100:00100000:3.0:1789672932.079249:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+36:12245:x1876607714275712:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:3.0:1789672932.079323:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b23 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079340:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079351:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079361:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079368:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079375:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079480:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965b31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079489:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965b31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079506:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965b31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672932.079567:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965b31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079581:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079588:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b23 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079594:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079600:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672932.079604:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079612:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b23 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079624:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:3.0:1789672932.079627:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672932.079631:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079644:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079700:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079707:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079713:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079718:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672932.079720:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079726:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079733:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb419b1f00) 00010000:00010000:3.0:1789672932.079735:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672932.079738:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079744:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079752:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965b31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079758:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965b31 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079769:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965b31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079777:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672932.079780:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965b31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079785:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965b31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079792:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:3.0:1789672932.079795:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672932.079797:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965b31 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.079803:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965b31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672932.079867:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+36:12245:x1876607714275712:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 618us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672932.079875:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 163 00000100:00100000:1.0:1789672932.082930:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672932.083310:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714275968 00000100:00100000:2.0:1789672932.083321:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714275968 00000100:00100000:2.0:1789672932.083382:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 40 00000100:00100000:2.0:1789672932.083391:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+36:12245:x1876607714275968:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:2.0:1789672932.083616:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+37:12245:x1876607714275968:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 225us (695us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789672932.083633:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 40 00000100:00100000:2.0:1789672932.131921:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672932.132016:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714276224 00000100:00100000:3.0:1789672932.132027:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714276224 00000100:00100000:3.0:1789672932.132088:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 164 00000100:00100000:3.0:1789672932.132098:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+37:12248:x1876607714276224:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789672932.132122:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672932.132143:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965b38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25226 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132256:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b3f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132271:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132283:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132293:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132299:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132305:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132416:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965b4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132425:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965b4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132432:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965b4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672932.132442:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789672932.132535:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132542:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b3f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132555:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132561:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672932.132566:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132574:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b3f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132586:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:3.0:1789672932.132589:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672932.132593:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b3f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132600:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132613:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132620:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132626:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132631:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672932.132633:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132649:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132722:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb419b1f00) 00010000:00010000:3.0:1789672932.132725:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672932.132729:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b46 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.132735:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.133272:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965b38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25226 expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.133287:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965b4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25226 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.133294:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:3.0:1789672932.133296:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672932.133299:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e4e00, rc 0) 00000100:00100000:3.0:1789672932.133375:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+39:12248:x1876607714276224:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 1278us (1464us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789672932.133383:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 164 00000100:00100000:0.0:1789672932.146270:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672932.146393:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714276352 00000100:00100000:1.0:1789672932.146410:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714276352 00000100:00100000:1.0:1789672932.146478:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 165 00000100:00100000:1.0:1789672932.146487:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+39:12248:x1876607714276352:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:1.0:1789672932.146607:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965b5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.146625:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.146644:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.146730:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.146738:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965b5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.146745:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965b5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.146751:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672932.146888:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965b5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.146897:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965b5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.146909:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:1.0:1789672932.146912:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672932.146917:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965b5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.146931:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965b5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672932.147035:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+39:12248:x1876607714276352:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 548us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672932.147044:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 165 00000100:00100000:1.0:1789672932.158405:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672932.161339:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714276608 00000100:00100000:3.0:1789672932.161353:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714276608 00000100:00100000:3.0:1789672932.161485:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:3.0:1789672932.161507:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+39:12248:x1876607714276608:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789672932.162440:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+40:12248:x1876607714276608:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 941us (4042us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789672932.162458:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:3.0:1789672932.170477:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789672932.170512:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47b81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738463616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789672932.170594:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672932.170953:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738463616 00000100:00100000:0.0:1789672932.170962:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738463616 00000100:00100000:0.0:1789672932.171017:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789672932.171040:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738463616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789672932.171073:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789672932.171127:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738463616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672932.171134:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789672932.171177:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47b81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738463616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789672932.471738:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672932.471829:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714276864 00000100:00100000:0.0:1789672932.471839:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714276864 00000100:00100000:0.0:1789672932.471906:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 166 00000100:00100000:0.0:1789672932.471918:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+40:12279:x1876607714276864:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:0.0:1789672932.471948:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672932.471970:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965b62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2522d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672932.472093:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965b69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672932.472108:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965b69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672932.472118:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965b69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672932.472129:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789672932.472249:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965b62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2522d expref: 43 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672932.472267:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965b69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2522d expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672932.472290:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:0.0:1789672932.472293:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789672932.472298:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cd200, rc 0) 00000100:00100000:0.0:1789672932.472358:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+42:12279:x1876607714276864:12345-192.168.201.50@tcp:101:cat.0 Request processed in 444us (634us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789672932.472364:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 166 00000100:00100000:0.0:1789672932.479280:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672932.479343:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672932.479449:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714277248 00000100:00100000:3.0:1789672932.479460:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714277248 00000100:00100000:3.0:1789672932.479543:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:3.0:1789672932.479554:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+42:2396:x1876607714277248:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672932.479570:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672932.479594:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965b69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2522d expref: 42 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.479614:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:3.0:1789672932.479619:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672932.479723:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+41:2396:x1876607714277248:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 171us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672932.479731:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:2.0:1789672932.480892:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714277120 00000100:00100000:2.0:1789672932.480901:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714277120 00000100:00100000:2.0:1789672932.480948:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:2.0:1789672932.480956:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+41:12279:x1876607714277120:12345-192.168.201.50@tcp:35:cat.0 00000100:00100000:2.0:1789672932.481178:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+42:12279:x1876607714277120:12345-192.168.201.50@tcp:35:cat.0 Request processed in 222us (1907us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1789672932.481185:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 42 00010000:00010000:2.0:1789672932.547900:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672932.549731:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672932.549826:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714277504 00000100:00100000:3.0:1789672932.549836:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714277504 00000100:00100000:3.0:1789672932.549898:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 167 00000100:00100000:3.0:1789672932.549909:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+42:12285:x1876607714277504:12345-192.168.201.50@tcp:101:dd.0 00010000:00010000:3.0:1789672932.549932:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672932.549936:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789672932.549960:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4400/0x6c78c4f8c9965acf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25203 expref: 42 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.549994:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:3.0:1789672932.550000:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672932.550014:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b77 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25234 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.550108:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b7e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.550122:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965b4d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25226 expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.550129:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b7e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.550160:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965b4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25226 expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.550173:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965b4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25226 expref: 42 pid: 6512 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672932.550186:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4824d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738463744:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672932.550299:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789672932.553363:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672932.553560:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714277632 00000100:00100000:0.0:1789672932.553572:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714277632 00010000:00010000:0.0:1789672932.553612:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965b4d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25226 expref: 43 pid: 6512 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672932.553689:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 84 00000100:00100000:0.0:1789672932.553698:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f86b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+43:2395:x1876607714277632:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672932.553713:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672932.553721:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965b4d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25226 expref: 43 pid: 6512 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672932.553734:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965b4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25226 expref: 43 pid: 6512 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672932.553754:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:0.0:1789672932.553760:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b7e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672932.553783:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b7e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672932.553791:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b7e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672932.553811:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672932.553870:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f86b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+43:2395:x1876607714277632:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 172us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672932.553877:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 84 00010000:00010000:3.0:1789672932.555271:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965b4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25226 expref: 42 pid: 6512 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672932.555296:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4824d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738463744:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789672932.555337:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b7e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.555347:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b7e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.555352:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b7e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672932.555372:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789672932.555538:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b77 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25234 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.555555:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b7e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25234 expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.555564:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:3.0:1789672932.555568:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789672932.555571:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e5200, rc 0) 00000100:00100000:3.0:1789672932.555638:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+42:12285:x1876607714277504:12345-192.168.201.50@tcp:101:dd.0 Request processed in 5731us (5917us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789672932.555646:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 167 00000100:00100000:1.0:1789672932.560561:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672932.560691:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714277760 00000100:00100000:3.0:1789672932.560702:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714277760 00000100:00100000:3.0:1789672932.560774:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 168 00000100:00100000:3.0:1789672932.560785:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+42:12285:x1876607714277760:12345-192.168.201.50@tcp:101:dd.0 00010000:00010000:3.0:1789672932.560813:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672932.560832:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4400/0x6c78c4f8c9965b8c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2523b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.560884:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965b93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.560897:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965b93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.560909:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965b93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.561019:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4400/0x6c78c4f8c9965b8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2523b expref: 44 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.561036:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965b93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2523b expref: 43 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.561045:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:3.0:1789672932.561048:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789672932.561052:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e5a00, rc 0) 00000100:00100000:3.0:1789672932.561110:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+43:12285:x1876607714277760:12345-192.168.201.50@tcp:101:dd.0 Request processed in 327us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672932.561117:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 168 00000100:00100000:2.0:1789672932.567562:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672932.567653:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714278016 00000100:00100000:3.0:1789672932.567688:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714278016 00000100:00100000:3.0:1789672932.567750:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 169 00000100:00100000:3.0:1789672932.567762:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+43:12285:x1876607714278016:12345-192.168.201.50@tcp:36:dd.0 00010000:00010000:3.0:1789672932.567983:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.568019:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.568031:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789672932.568076:0:9524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1789672932.568100:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c9d0fde reply state 000000002563475e transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.568114:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.568122:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:3.0:1789672932.568125:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789672932.568128:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789672932.568224:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+46:12285:x1876607714278016:12345-192.168.201.50@tcp:36:dd.0 Request processed in 465us (672us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1789672932.568232:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 169 00000020:00080000:3.0:1789672932.568236:0:9524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789672932.884246:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672932.884345:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714278144 00000100:00100000:3.0:1789672932.884356:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714278144 00000100:00100000:3.0:1789672932.884579:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 170 00000100:00100000:3.0:1789672932.884591:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+46:12299:x1876607714278144:12345-192.168.201.50@tcp:101:stat.0 00010000:00010000:3.0:1789672932.884625:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672932.884643:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4400/0x6c78c4f8c9965ba1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25242 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.884718:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965ba8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.884741:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.884750:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.884758:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4800/0x6c78c4f8c9965baf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.884762:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4800/0x6c78c4f8c9965baf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.884766:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4800/0x6c78c4f8c9965baf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.884819:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965bb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.884826:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b7e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25234 expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.884832:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965bb6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.884858:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b7e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25234 expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.884868:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b7e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25234 expref: 47 pid: 6512 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672932.884886:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4824d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738463872:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672932.885001:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789672932.888771:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4824d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738463872:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789672932.888805:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965bb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672932.891291:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672932.891598:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714278400 00000100:00100000:1.0:1789672932.891608:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714278400 00000100:00100000:1.0:1789672932.891766:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:1.0:1789672932.891776:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+48:6169:x1876607714278400:12345-192.168.201.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789672932.892945:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+49:6169:x1876607714278400:12345-192.168.201.50@tcp:35:ldlm_bl.0 Request processed in 1165us (1657us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789672932.892956:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:2.0:1789672932.910293:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672932.911068:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714278528 00000100:00100000:3.0:1789672932.911080:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714278528 00010000:00010000:3.0:1789672932.911123:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b7e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25234 expref: 49 pid: 6512 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672932.911223:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 85 00000100:00100000:3.0:1789672932.911234:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47906d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+49:2396:x1876607714278528:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672932.911249:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672932.911256:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b7e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25234 expref: 49 pid: 6512 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.911269:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b7e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25234 expref: 49 pid: 6512 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.911290:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965b7e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25234 expref: 49 pid: 6512 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.911316:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:3.0:1789672932.911322:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965bb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.911345:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.911353:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965bb6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672932.911389:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672932.911461:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47906d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+48:2396:x1876607714278528:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 228us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672932.911470:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 85 00010000:00010000:1.0:1789672932.912435:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912461:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672932.912725:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789672932.912730:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789672932.912755:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912771:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912781:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912788:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965ba8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912795:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912801:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4e00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672932.912805:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912813:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965ba8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912825:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:1.0:1789672932.912828:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672932.912833:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965ba8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912849:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965ba8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912863:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4800/0x6c78c4f8c9965baf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912869:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4800/0x6c78c4f8c9965baf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912875:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4800/0x6c78c4f8c9965baf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912879:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672932.912883:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4800/0x6c78c4f8c9965baf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912889:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4800/0x6c78c4f8c9965baf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912897:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb419b1f00) 00010000:00010000:1.0:1789672932.912899:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672932.912901:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4800/0x6c78c4f8c9965baf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912907:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4800/0x6c78c4f8c9965baf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912941:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4400/0x6c78c4f8c9965ba1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25242 expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912956:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25242 expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672932.912969:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:1.0:1789672932.912971:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672932.912974:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e4c00, rc 0) 00000100:00100000:1.0:1789672932.913022:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+47:12299:x1876607714278144:12345-192.168.201.50@tcp:101:stat.0 Request processed in 28434us (28786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672932.913030:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 170 00000100:00100000:2.0:1789672933.004249:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672933.004352:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714278784 00000100:00100000:0.0:1789672933.004362:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714278784 00000100:00100000:0.0:1789672933.004447:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 171 00000100:00100000:0.0:1789672933.004460:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+47:12305:x1876607714278784:12345-192.168.201.50@tcp:36:truncate.0 00010000:00010000:0.0:1789672933.004533:0:6514:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672933.004566:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965bb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25242 expref: 47 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.004584:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:0.0:1789672933.004588:0:6514:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672933.004827:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965bbd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.004844:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965bbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.004855:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965bbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672933.004923:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1789672933.004945:0:6514:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045a24c06 reply state 000000001500d57d transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965bbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.004957:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965bbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.004963:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:0.0:1789672933.004966:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789672933.004969:0:6514:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789672933.005080:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+49:12305:x1876607714278784:12345-192.168.201.50@tcp:36:truncate.0 Request processed in 623us (839us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1789672933.005087:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 171 00000020:00080000:0.0:1789672933.005092:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1789672933.005258:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672933.188779:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672933.189165:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714278912 00000100:00100000:1.0:1789672933.189176:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714278912 00000100:00100000:1.0:1789672933.189251:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 172 00000100:00100000:1.0:1789672933.189264:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+49:12319:x1876607714278912:12345-192.168.201.50@tcp:101:stat.0 00010000:00010000:1.0:1789672933.189291:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672933.189314:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965bc4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25249 expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.189381:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965bcb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.189395:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965bcb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.189408:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965bcb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.189418:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965bd2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.189437:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.189462:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.189565:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965bd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.189575:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.189601:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672933.189925:0:11081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789672933.189930:0:11081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789672933.189950:0:11081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.189962:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.189970:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965bcb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.189977:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965bcb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.189984:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965bcb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.189989:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672933.189993:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965bcb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.190007:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965bcb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.190020:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:1.0:1789672933.190023:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672933.190027:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965bcb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.190034:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965bcb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.190047:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.190053:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965bd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.190154:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.190160:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672933.190164:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.190171:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.190179:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb419b1f00) 00010000:00010000:1.0:1789672933.190182:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672933.190185:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965bd2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.190200:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965bd2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.190229:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965bc4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25249 expref: 51 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.190242:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25249 expref: 50 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.190248:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:1.0:1789672933.190250:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672933.190253:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434c00, rc 0) 00000100:00100000:1.0:1789672933.190322:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+50:12319:x1876607714278912:12345-192.168.201.50@tcp:101:stat.0 Request processed in 1061us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672933.190330:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 172 00000100:00100000:3.0:1789672933.309000:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672933.309114:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714279168 00000100:00100000:1.0:1789672933.309125:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714279168 00000100:00100000:1.0:1789672933.309198:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 173 00000100:00100000:1.0:1789672933.309209:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+50:12329:x1876607714279168:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789672933.309231:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672933.309252:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965be0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25250 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672933.309370:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789672933.309492:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965be0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25250 expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.309527:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc4991c100) 00010000:00010000:1.0:1789672933.309530:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672933.309536:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965be0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25250 expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.309551:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434600, rc 0) 00000100:00100000:1.0:1789672933.309607:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+51:12329:x1876607714279168:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 400us (629us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1789672933.309625:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 173 00000100:00100000:2.0:1789672933.315964:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672933.316445:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714279424 00000100:00100000:3.0:1789672933.316458:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714279424 00000100:00100000:3.0:1789672933.316581:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:3.0:1789672933.316593:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f850850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+51:12329:x1876607714279424:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789672933.316942:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f850850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+52:12329:x1876607714279424:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 349us (986us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789672933.316951:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:2.0:1789672933.430923:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672933.434124:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714279680 00000100:00100000:0.0:1789672933.434142:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714279680 00000100:00100000:0.0:1789672933.434237:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 174 00000100:00100000:0.0:1789672933.434247:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+52:12335:x1876607714279680:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789672933.434273:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672933.434295:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965bee lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25257 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.434411:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965bf5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.434428:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965bd9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25249 expref: 53 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.434460:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965bf5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.434526:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25249 expref: 53 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.434541:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25249 expref: 53 pid: 11081 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672933.434556:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47b80380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738464000:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789672933.434719:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d8059c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789672933.443601:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672933.444044:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714279808 00000100:00100000:3.0:1789672933.444055:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714279808 00010000:00010000:3.0:1789672933.444107:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965bd9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25249 expref: 54 pid: 11081 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672933.444147:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 86 00000100:00100000:3.0:1789672933.444169:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+54:2395:x1876607714279808:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672933.444184:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672933.444214:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965bd9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25249 expref: 54 pid: 11081 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.444228:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25249 expref: 54 pid: 11081 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.444249:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:3.0:1789672933.444255:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965bf5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.444264:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.444271:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965bf5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.444290:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672933.444350:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+54:2395:x1876607714279808:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 195us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672933.444357:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 86 00010000:00010000:0.0:1789672933.457738:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965bd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25249 expref: 53 pid: 11081 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672933.457765:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47b80380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738464000:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789672933.457789:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.457800:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.457805:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672933.457828:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1789672933.457970:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965bee lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25257 expref: 54 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.458006:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965bf5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25257 expref: 53 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.458015:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:0.0:1789672933.458018:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789672933.458021:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cc600, rc 0) 00000100:00100000:0.0:1789672933.458095:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+53:12335:x1876607714279680:12345-192.168.201.50@tcp:101:bash.0 Request processed in 23848us (27180us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789672933.458104:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 174 00000100:00100000:2.0:1789672933.468330:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672933.468539:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714280064 00000100:00100000:1.0:1789672933.468550:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714280064 00000100:00100000:1.0:1789672933.468623:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 175 00000100:00100000:1.0:1789672933.468635:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+53:12335:x1876607714280064:12345-192.168.201.50@tcp:36:bash.0 00010000:00010000:1.0:1789672933.468906:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965c03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.468925:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965c03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.468937:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965c03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789672933.468976:0:11081:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1789672933.468998:0:11081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bbc8051 reply state 00000000db1cbe4e transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965c03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.469010:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965c03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.469031:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:1.0:1789672933.469034:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789672933.469037:0:11081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789672933.469132:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+56:12335:x1876607714280064:12345-192.168.201.50@tcp:36:bash.0 Request processed in 500us (813us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1789672933.469140:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 175 00000020:00080000:1.0:1789672933.469144:0:11081:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789672933.483943:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672933.484698:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714280192 00000100:00100000:3.0:1789672933.484710:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714280192 00000100:00100000:3.0:1789672933.484778:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 176 00000100:00100000:3.0:1789672933.484790:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+56:12335:x1876607714280192:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789672933.484816:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672933.484838:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4200/0x6c78c4f8c9965c0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2525e expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.484934:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5c00/0x6c78c4f8c9965c11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.484962:0:9524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965bf5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25257 expref: 57 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.484971:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5c00/0x6c78c4f8c9965c11 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.485005:0:9524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965bf5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25257 expref: 57 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.485018:0:9524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965bf5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25257 expref: 57 pid: 6514 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672933.485031:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4824f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876607738464128:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672933.485395:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc81a0b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672933.496026:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4824f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876607738464128:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789672933.496063:0:9524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5c00/0x6c78c4f8c9965c11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672933.502873:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672933.502978:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714280320 00000100:00100000:0.0:1789672933.502988:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714280320 00010000:00010000:0.0:1789672933.503029:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965bf5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25257 expref: 58 pid: 6514 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672933.503073:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 87 00000100:00100000:0.0:1789672933.503084:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:2396:x1876607714280320:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672933.503109:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672933.503117:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965bf5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25257 expref: 58 pid: 6514 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.503130:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965bf5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25257 expref: 58 pid: 6514 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.503150:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965bf5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25257 expref: 58 pid: 6514 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.503181:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:0.0:1789672933.503187:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5c00/0x6c78c4f8c9965c11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.503196:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5c00/0x6c78c4f8c9965c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.503202:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5c00/0x6c78c4f8c9965c11 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.503236:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672933.503298:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+57:2396:x1876607714280320:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 215us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672933.503305:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 87 00010000:00010000:2.0:1789672933.505010:0:9524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5c00/0x6c78c4f8c9965c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672933.507257:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5c00/0x6c78c4f8c9965c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672933.507343:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789672933.507347:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789672933.507371:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5c00/0x6c78c4f8c9965c11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672933.507410:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4200/0x6c78c4f8c9965c0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2525e expref: 57 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672933.507433:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5c00/0x6c78c4f8c9965c11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2525e expref: 56 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672933.507442:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:2.0:1789672933.507444:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672933.507447:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e5c00, rc 0) 00000100:00100000:2.0:1789672933.507617:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+56:12335:x1876607714280192:12345-192.168.201.50@tcp:101:bash.0 Request processed in 22827us (23681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672933.507626:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 176 00000100:00100000:1.0:1789672933.523071:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672933.526509:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714280576 00000100:00100000:2.0:1789672933.526528:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714280576 00000100:00100000:3.0:1789672933.527073:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 45 00000100:00100000:3.0:1789672933.527088:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+56:12335:x1876607714280576:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:3.0:1789672933.527338:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+57:12335:x1876607714280576:12345-192.168.201.50@tcp:35:bash.0 Request processed in 254us (4275us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789672933.527351:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 45 00010000:00010000:1.0:1789672933.571936:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672933.624840:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672933.625919:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714280832 00000100:00100000:0.0:1789672933.625931:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714280832 00000100:00100000:0.0:1789672933.625983:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 177 00000100:00100000:0.0:1789672933.625993:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+57:12345:x1876607714280832:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789672933.626019:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672933.626041:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965c18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25265 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672933.626141:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789672933.626255:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965c18 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25265 expref: 59 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.626281:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc4991c100) 00010000:00010000:0.0:1789672933.626298:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789672933.626305:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965c18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25265 expref: 59 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.626319:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cd200, rc 0) 00000100:00100000:0.0:1789672933.626394:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:12345:x1876607714280832:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 401us (1563us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1789672933.626402:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 177 00000100:00100000:0.0:1789672933.631072:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672933.631160:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714280960 00000100:00100000:3.0:1789672933.631192:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714280960 00000100:00100000:3.0:1789672933.631252:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 178 00000100:00100000:3.0:1789672933.631262:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:12345:x1876607714280960:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:3.0:1789672933.631336:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c26 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631354:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631364:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631374:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631380:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631386:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631481:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5e00/0x6c78c4f8c9965c34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631489:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5e00/0x6c78c4f8c9965c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631496:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5e00/0x6c78c4f8c9965c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789672933.631542:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5e00/0x6c78c4f8c9965c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631565:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631571:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c26 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631577:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631582:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672933.631586:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631592:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c26 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631615:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:3.0:1789672933.631618:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672933.631623:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c26 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631629:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631643:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631649:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631655:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631706:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672933.631710:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631716:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631725:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb419b1f00) 00010000:00010000:3.0:1789672933.631727:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672933.631903:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c2d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631912:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631924:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5e00/0x6c78c4f8c9965c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631930:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5e00/0x6c78c4f8c9965c34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631936:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5e00/0x6c78c4f8c9965c34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631941:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5e00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672933.631944:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5e00/0x6c78c4f8c9965c34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631949:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5e00/0x6c78c4f8c9965c34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631969:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:3.0:1789672933.631971:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672933.631974:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5e00/0x6c78c4f8c9965c34 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.631981:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5e00/0x6c78c4f8c9965c34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672933.632066:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:12345:x1876607714280960:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 804us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672933.632074:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 178 00000100:00100000:2.0:1789672933.634928:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672933.635038:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714281216 00000100:00100000:3.0:1789672933.635048:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714281216 00000100:00100000:3.0:1789672933.635117:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00100000:3.0:1789672933.635128:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:12345:x1876607714281216:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789672933.635362:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+59:12345:x1876607714281216:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 235us (441us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789672933.635370:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 46 00000040:00080000:3.0:1789672933.637875:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672933.637884:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789672933.637982:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1789672933.637990:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789672933.692396:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672933.692530:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714281472 00000100:00100000:3.0:1789672933.692541:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714281472 00000100:00100000:3.0:1789672933.692693:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 179 00000100:00100000:3.0:1789672933.692706:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f60b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+59:12348:x1876607714281472:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789672933.692740:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672933.692775:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5e00/0x6c78c4f8c9965c3b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2526c expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.692850:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c42 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.692864:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.692876:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.692885:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.692891:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.692897:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693005:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4200/0x6c78c4f8c9965c50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693014:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4200/0x6c78c4f8c9965c50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693021:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4200/0x6c78c4f8c9965c50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672933.693030:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789672933.693101:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693118:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c42 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693124:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693130:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672933.693134:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693141:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c42 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693152:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:3.0:1789672933.693154:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672933.693160:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693165:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9965c42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693179:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693185:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693202:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693208:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672933.693217:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693224:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693231:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb419b1f00) 00010000:00010000:3.0:1789672933.693234:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672933.693237:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c49 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693243:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c9965c49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693282:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5e00/0x6c78c4f8c9965c3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2526c expref: 62 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693363:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4200/0x6c78c4f8c9965c50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2526c expref: 61 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.693371:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:3.0:1789672933.693374:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672933.693376:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e4200, rc 0) 00000100:00100000:3.0:1789672933.693440:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f60b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:12348:x1876607714281472:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 737us (1156us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1789672933.693447:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 179 00000100:00100000:0.0:1789672933.698006:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672933.698043:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672933.698096:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714281728 00000100:00100000:3.0:1789672933.698104:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714281728 00000100:00100000:3.0:1789672933.698160:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:3.0:1789672933.698168:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:2395:x1876607714281728:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672933.698210:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672933.698233:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4200/0x6c78c4f8c9965c50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2526c expref: 61 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672933.698253:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:3.0:1789672933.698258:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672933.698309:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:2395:x1876607714281728:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 140us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672933.698316:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:2.0:1789672933.698851:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714281600 00000100:00100000:2.0:1789672933.698856:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714281600 00000100:00100000:2.0:1789672933.698926:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 180 00000100:00100000:2.0:1789672933.698934:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:12348:x1876607714281600:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:2.0:1789672933.698994:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965c5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672933.699009:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965c5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672933.699019:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965c5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672933.699052:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965c5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672933.699059:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965c5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672933.699065:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965c5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672933.699070:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aee800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672933.699074:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965c5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672933.699080:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965c5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672933.699088:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:2.0:1789672933.699090:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789672933.699094:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965c5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672933.699100:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c9965c5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672933.699150:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:12348:x1876607714281600:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 217us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672933.699157:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 180 00000004:00080000:0.0:1789672933.699969:0:9982:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411615309668ns, next at 412615306980ns, rc = 0 00000100:00100000:3.0:1789672933.700022:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672933.700039:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738464256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672933.700091:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672933.700312:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738464256 00000100:00100000:0.0:1789672933.700319:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738464256 00000100:00100000:0.0:1789672933.700366:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789672933.700375:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876607738464256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672933.700398:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789672933.700448:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876607738464256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672933.700455:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789672933.700521:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738464384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789672933.700546:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672933.700593:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738464256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672933.700846:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738464384 00000100:00100000:0.0:1789672933.700852:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738464384 00000100:00100000:0.0:1789672933.700885:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789672933.700892:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738464384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789672933.700903:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789672933.700937:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738464384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672933.700955:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789672933.700983:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f60b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738464384:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789672933.701093:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789672933.701355:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4824ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738464640:0@lo:400:kworker.0 00000100:00100000:2.0:1789672933.701387:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672933.701428:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876607738465152:0@lo:400:kworker.0 00000100:00100000:2.0:1789672933.701450:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672933.701473:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876607738465664:0@lo:400:kworker.0 00000100:00100000:2.0:1789672933.701495:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672933.701515:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789672933.701520:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4824ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738464512:0@lo:400:kworker.0 00000100:00100000:2.0:1789672933.701543:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672933.701560:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4824d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738465024:0@lo:400:kworker.0 00000100:00100000:2.0:1789672933.701585:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672933.701597:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738465536:0@lo:400:kworker.0 00000100:00100000:2.0:1789672933.701630:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672933.702372:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738464640 00000100:00100000:3.0:1789672933.702382:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738464640 00000100:00100000:3.0:1789672933.702438:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738465152 00000100:00100000:3.0:1789672933.702441:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738465152 00000100:00100000:3.0:1789672933.702476:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738465664 00000100:00100000:3.0:1789672933.702479:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738465664 00000100:00100000:3.0:1789672933.702498:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789672933.702505:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738464640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672933.702565:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f60a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738464640:12345-0@lo:400:kworker.0 Request processed in 60us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672933.702571:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789672933.702597:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00080000:2.0:1789672933.702820:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789672933.702852:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4824ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738464640:0@lo:400:kworker.0 00000100:00100000:2.0:1789672933.702878:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789672933.702886:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876607738465664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672933.702924:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876607738465664:12345-0@lo:400:kworker.0 Request processed in 39us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672933.702939:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789672933.702965:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876607738465664:0@lo:400:kworker.0 00000100:00100000:0.0:1789672933.703032:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738465536 00000100:00100000:0.0:1789672933.703037:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738465536 00000100:00100000:0.0:1789672933.703087:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789672933.703095:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f60b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738465536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672933.703133:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f60b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738465536:12345-0@lo:400:kworker.0 Request processed in 40us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672933.703139:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789672933.703162:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4824e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738464896:0@lo:400:kworker.0 00000100:00100000:3.0:1789672933.703531:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876607738465152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672933.703577:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672933.703695:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4824df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738464768:0@lo:400:kworker.0 00000100:00080000:2.0:1789672933.703758:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672933.703889:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876607738465152:12345-0@lo:400:kworker.0 Request processed in 1286us (2437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672933.703895:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789672933.703910:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738464896 00000100:00100000:3.0:1789672933.703915:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738464896 00000100:00100000:3.0:1789672933.703945:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789672933.703952:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738464896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672933.703981:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738464896:12345-0@lo:400:kworker.0 Request processed in 30us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672933.703986:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789672933.705245:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4824e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738464896:0@lo:400:kworker.0 00000100:00100000:0.0:1789672933.705259:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738465408:0@lo:400:kworker.0 00000100:00100000:0.0:1789672933.705302:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672933.705406:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738465536:0@lo:400:kworker.0 00000100:00100000:0.0:1789672933.705430:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876607738465152:0@lo:400:kworker.0 00000100:00100000:1.0:1789672933.705722:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672933.705908:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672933.705975:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876607738465280:0@lo:400:kworker.0 00000100:00100000:1.0:1789672933.706002:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672933.706020:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738465792:0@lo:400:kworker.0 00000100:00100000:1.0:1789672933.706038:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672933.706073:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738464512 00000100:00100000:1.0:1789672933.706080:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738464512 00000100:00100000:1.0:1789672933.706117:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789672933.706125:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3636:x1876607738464512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672933.706168:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3636:x1876607738464512:12345-0@lo:400:kworker.0 Request processed in 44us (4623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672933.706175:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1789672933.706381:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738465024 00000100:00100000:2.0:1789672933.706387:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738465024 00000100:00100000:2.0:1789672933.706427:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738464768 00000100:00100000:2.0:1789672933.706431:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738464768 00000100:00100000:2.0:1789672933.706446:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789672933.706452:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc45827c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738465024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672933.706499:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc45827c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738465024:12345-0@lo:400:kworker.0 Request processed in 47us (4912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672933.706505:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789672933.706933:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789672933.706940:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738464768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672933.706976:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738464768:12345-0@lo:400:kworker.0 Request processed in 36us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672933.706982:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789672933.707011:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4824df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738464768:0@lo:400:kworker.0 00000100:00100000:1.0:1789672933.707188:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738465280 00000100:00100000:1.0:1789672933.707193:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738465280 00000100:00100000:1.0:1789672933.707234:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738465792 00000100:00100000:1.0:1789672933.707237:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738465792 00000100:00100000:1.0:1789672933.707272:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789672933.707278:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876607738465280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672933.707315:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876607738465280:12345-0@lo:400:kworker.0 Request processed in 38us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672933.707321:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00010000:00080000:1.0:1789672933.707344:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8dea00 x1876607738465280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672933.707355:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1876607738465280:0@lo:400:kworker.0 00000100:00100000:1.0:1789672933.707371:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789672933.707377:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738465792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672933.707407:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738465792:12345-0@lo:400:kworker.0 Request processed in 31us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672933.707492:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00010000:00080000:1.0:1789672933.707513:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb479d3800 x1876607738465792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672933.707523:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738465792:0@lo:400:kworker.0 00000100:00100000:0.0:1789672933.707795:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4824ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738464512:0@lo:400:kworker.0 00000100:00100000:0.0:1789672933.707807:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4824d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738465024:0@lo:400:kworker.0 00000100:00100000:0.0:1789672933.707834:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714281984 00000100:00100000:0.0:1789672933.707838:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714281984 00000100:00100000:0.0:1789672933.707875:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:0.0:1789672933.707882:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:12348:x1876607714281984:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:0.0:1789672933.708061:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:12348:x1876607714281984:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 179us (2154us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789672933.708067:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00080000:2.0:1789672933.711053:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789672933.712081:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738465408 00000100:00100000:3.0:1789672933.712092:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738465408 00000100:00100000:3.0:1789672933.712162:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789672933.712170:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738465408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672933.712279:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738465408:12345-0@lo:400:kworker.0 Request processed in 109us (6975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672933.712286:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1789672933.712392:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672933.712483:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738465408:0@lo:400:kworker.0 00000100:00100000:2.0:1789672933.880207:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672933.880316:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714282240 00000100:00100000:0.0:1789672933.880329:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714282240 00000100:00100000:0.0:1789672933.880400:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 181 00000100:00100000:0.0:1789672933.880413:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+61:12366:x1876607714282240:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:0.0:1789672933.880442:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672933.880476:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965c65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25273 expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.880588:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965c6c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.880617:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965c6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.880630:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965c6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672933.880645:0:11081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789672933.880870:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965c65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25273 expref: 64 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.880890:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965c6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25273 expref: 63 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.880898:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:0.0:1789672933.880915:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789672933.880919:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cc800, rc 0) 00000100:00100000:0.0:1789672933.880993:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:12366:x1876607714282240:12345-192.168.201.50@tcp:101:cat.0 Request processed in 582us (807us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789672933.881000:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 181 00000100:00100000:0.0:1789672933.904510:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672933.904727:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714282368 00000100:00100000:1.0:1789672933.904737:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714282368 00000100:00100000:1.0:1789672933.904801:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 182 00000100:00100000:1.0:1789672933.904811:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:12367:x1876607714282368:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789672933.904837:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672933.904861:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965c7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2527a expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.904954:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965c81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.904970:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.904982:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672933.905029:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789672933.905033:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789672933.905053:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965c81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.905083:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965c7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2527a expref: 65 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.905103:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965c81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2527a expref: 64 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.905111:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:1.0:1789672933.905114:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672933.905119:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434a00, rc 0) 00000100:00100000:1.0:1789672933.905202:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+64:12367:x1876607714282368:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 383us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672933.905209:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 182 00000100:00100000:3.0:1789672933.918143:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672933.918251:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714282752 00000100:00100000:0.0:1789672933.918261:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714282752 00000100:00100000:0.0:1789672933.918319:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:0.0:1789672933.918330:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+64:12367:x1876607714282752:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:0.0:1789672933.918654:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:12367:x1876607714282752:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 325us (522us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789672933.918693:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:3.0:1789672933.921803:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672933.921948:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714282880 00000100:00100000:0.0:1789672933.921959:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714282880 00000100:00100000:0.0:1789672933.922025:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:0.0:1789672933.922035:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:12367:x1876607714282880:12345-192.168.201.50@tcp:103:lfs.0 00010000:00010000:0.0:1789672933.922050:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789672933.922075:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5c00/0x6c78c4f8c9965c11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2525e expref: 65 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.922098:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965c6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25273 expref: 64 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.922111:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965b0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25218 expref: 63 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.922139:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:0.0:1789672933.922144:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672933.922316:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+62:12367:x1876607714282880:12345-192.168.201.50@tcp:103:lfs.0 Request processed in 282us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672933.922324:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:2.0:1789672933.925927:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672933.925997:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714283008 00000100:00100000:0.0:1789672933.926007:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714283008 00000100:00100000:0.0:1789672933.926078:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 183 00000100:00100000:0.0:1789672933.926089:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+62:12367:x1876607714283008:12345-192.168.201.50@tcp:58:lfs.0 00010000:00010000:0.0:1789672933.926210:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965c88 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.926227:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965c88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672933.926238:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965c88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789672933.926333:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789672933.926416:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+62:12367:x1876607714283008:12345-192.168.201.50@tcp:58:lfs.0 Request processed in 328us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672933.926423:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 183 00000100:00100000:2.0:1789672933.954285:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672933.954864:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714283136 00000100:00100000:1.0:1789672933.954876:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714283136 00000100:00100000:1.0:1789672933.955003:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 184 00000100:00100000:1.0:1789672933.955013:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+62:12369:x1876607714283136:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789672933.955035:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672933.955057:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965c8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25281 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955132:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965c96 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955149:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965c96 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955160:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965c96 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955171:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965c9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955179:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965c9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955186:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965c9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955272:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ca4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955282:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955289:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672933.955341:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789672933.955346:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789672933.955365:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955377:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955385:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965c96 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955392:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965c96 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955399:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965c96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955415:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672933.955420:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965c96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955428:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965c96 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955440:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:1.0:1789672933.955443:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672933.955447:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965c96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955453:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965c96 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955488:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965c9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955494:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965c9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955499:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965c9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955505:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672933.955507:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965c9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955513:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965c9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955520:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb419b1f00) 00010000:00010000:1.0:1789672933.955522:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672933.955525:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965c9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955529:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965c9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955557:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965c8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25281 expref: 64 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955569:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25281 expref: 63 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672933.955585:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:1.0:1789672933.955587:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672933.955590:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435600, rc 0) 00000100:00100000:1.0:1789672933.955924:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:12369:x1876607714283136:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 912us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672933.955931:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 184 00000040:00080000:1.0:1789672934.212318:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789672934.600237:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789672934.659923:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672934.659935:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789672934.659963:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789672934.659972:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789672934.660111:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1876607738465920:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789672934.660489:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc67ebc000 going to sleep for 11 seconds 00000100:00100000:2.0:1789672934.673973:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672934.674006:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714283264 00000100:00100000:2.0:1789672934.674022:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714283264 00000100:00100000:2.0:1789672934.674087:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 185 00000100:00100000:2.0:1789672934.674099:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+64:12380:x1876607714283264:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789672934.674131:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789672934.674239:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+64:12380:x1876607714283264:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 142us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672934.674246:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 185 00000040:00080000:2.0:1789672934.681034:0:14653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789672934.681046:0:14653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789672934.681073:0:14653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789672934.681082:0:14653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789672934.683756:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1876607738465920:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789672934.698394:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672934.707073:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714283392 00000100:00100000:3.0:1789672934.707086:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714283392 00000100:00100000:3.0:1789672934.707158:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 186 00000100:00100000:3.0:1789672934.707169:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:12380:x1876607714283392:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789672934.707239:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5600/0x6c78c4f8c9965cab lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.707257:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5600/0x6c78c4f8c9965cab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.707268:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5600/0x6c78c4f8c9965cab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.707319:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965cb2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.707327:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.707333:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.707360:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965cb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.707369:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.707376:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672934.707433:0:11081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789672934.707554:0:11081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789672934.707569:0:11081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.707582:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5600/0x6c78c4f8c9965cab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.707930:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5600/0x6c78c4f8c9965cab lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.707938:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5600/0x6c78c4f8c9965cab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.707944:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672934.707948:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5600/0x6c78c4f8c9965cab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.707956:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5600/0x6c78c4f8c9965cab lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.707970:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfc61501100) 00010000:00010000:3.0:1789672934.707973:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672934.707978:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5600/0x6c78c4f8c9965cab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.707985:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5600/0x6c78c4f8c9965cab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.707999:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.708005:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965cb2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.708023:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.708028:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672934.708031:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.708037:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965cb2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.708045:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8cfb419b1100) 00010000:00010000:3.0:1789672934.708047:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672934.708050:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965cb2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.708056:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965cb2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.708072:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.708078:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965cb9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.708083:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.708088:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672934.708091:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.708106:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965cb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.708114:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:3.0:1789672934.708116:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672934.708119:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965cb9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.708125:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965cb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672934.708208:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:12380:x1876607714283392:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 Request processed in 1039us (9820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672934.708217:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 186 00000100:00100000:2.0:1789672934.724020:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672934.724259:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714283648 00000100:00100000:1.0:1789672934.724270:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714283648 00000100:00100000:1.0:1789672934.724330:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 187 00000100:00100000:1.0:1789672934.724341:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:12380:x1876607714283648:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672934.724360:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672934.724381:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965cc0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25288 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.724507:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.724521:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.724901:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672934.724916:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789672934.724997:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.725022:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cc7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.725029:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.725035:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672934.725040:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.725047:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.725058:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:1.0:1789672934.725060:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672934.725065:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cc7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.725071:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.725115:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965cc0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25288 expref: 65 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.725125:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfc61501100) 00010000:00010000:1.0:1789672934.725127:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672934.725131:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965cc0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25288 expref: 65 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.725140:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434200, rc 0) 00000100:00100000:1.0:1789672934.725240:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+64:12380:x1876607714283648:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 899us (1227us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1789672934.725248:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 187 00000100:00100000:0.0:1789672934.756726:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672934.756763:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714283776 00000100:00100000:0.0:1789672934.756781:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714283776 00000100:00100000:0.0:1789672934.756834:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 188 00000100:00100000:0.0:1789672934.756844:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+64:12380:x1876607714283776:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789672934.756878:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789672934.757000:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+64:12380:x1876607714283776:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 156us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672934.757007:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 188 00000100:00100000:2.0:1789672934.764857:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672934.765010:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714284032 00000100:00100000:3.0:1789672934.765020:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714284032 00000100:00100000:3.0:1789672934.765079:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 189 00000100:00100000:3.0:1789672934.765090:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d96d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+64:12380:x1876607714284032:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789672934.765111:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672934.765114:0:11081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789672934.765143:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965c81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2527a expref: 64 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.765163:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:3.0:1789672934.765169:0:11081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672934.765183:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965cd5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2528f expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789672934.766840:0:11081:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789672934.768120:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965cdc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.768139:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965cdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.768150:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965cdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.768217:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965cd5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2528f expref: 66 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.768234:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965cdc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2528f expref: 65 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.768243:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cfb419b1100) 00010000:00010000:3.0:1789672934.768246:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672934.768250:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e5200, rc 0) 00000100:00100000:3.0:1789672934.768325:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d96d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:12380:x1876607714284032:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 3236us (3477us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789672934.768334:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 189 00000100:00100000:0.0:1789672934.776154:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672934.776290:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714284288 00000100:00100000:1.0:1789672934.776301:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714284288 00000100:00100000:1.0:1789672934.776891:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 190 00000100:00100000:1.0:1789672934.776904:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:12380:x1876607714284288:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789672934.777091:0:6513:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672934.777118:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5200/0x6c78c4f8c9965cdc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2528f expref: 65 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777138:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cfb419b1100) 00010000:00010000:1.0:1789672934.777147:0:6513:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672934.777168:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965cea lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777183:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965cea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777194:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965cea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777208:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cf1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xae27e863 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777214:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xae27e863 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777220:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xae27e863 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777273:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965cea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777280:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965cea lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777286:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965cea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777292:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672934.777296:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965cea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777303:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965cea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777312:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:1.0:1789672934.777315:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672934.777318:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965cea lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777324:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965cea lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777332:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xae27e863 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777337:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cf1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xae27e863 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777342:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cf1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xae27e863 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777352:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672934.777355:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cf1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xae27e863 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777361:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cf1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xae27e863 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777369:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xae27e863 (ffff8cfc61501700) 00010000:00010000:1.0:1789672934.777371:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672934.777374:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cf1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xae27e863 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.777379:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965cf1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xae27e863 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672934.777537:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+64:12380:x1876607714284288:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 628us (1385us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789672934.777553:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 190 00000100:00100000:0.0:1789672934.782210:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672934.782277:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714284416 00000100:00100000:1.0:1789672934.782288:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714284416 00000100:00100000:1.0:1789672934.782349:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 191 00000100:00100000:1.0:1789672934.782361:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+64:12380:x1876607714284416:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672934.782383:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672934.782405:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965cf8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25296 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.782441:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965cff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.782477:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965cff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.782489:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965cff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.782623:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965cf8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25296 expref: 66 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.782640:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965cff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25296 expref: 65 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.782647:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cfc61501800) 00010000:00010000:1.0:1789672934.782650:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789672934.782654:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434a00, rc 0) 00000100:00100000:0.0:1789672934.783030:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:12380:x1876607714284416:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 670us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672934.783037:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 191 00000100:00100000:0.0:1789672934.787357:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672934.787455:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714284672 00000100:00100000:1.0:1789672934.787465:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714284672 00000100:00100000:1.0:1789672934.787537:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 192 00000100:00100000:1.0:1789672934.787556:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:12380:x1876607714284672:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789672934.787638:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965d06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.787654:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965d06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.787854:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965d06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789672934.787999:0:11081:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1789672934.788016:0:11081:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 412703357156ns, next at 413703355134ns, rc = 0 00000004:00010000:1.0:1789672934.788058:0:11081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010dad0c9 reply state 000000005257e0b9 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965d06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.788070:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965d06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.788078:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cfc61501800) 00010000:00010000:1.0:1789672934.788081:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789672934.788085:0:11081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789672934.788266:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:12380:x1876607714284672:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 713us (920us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789672934.788274:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 192 00000100:00100000:1.0:1789672934.799253:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672934.799329:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714284800 00000100:00100000:2.0:1789672934.799340:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714284800 00000100:00100000:2.0:1789672934.799458:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 193 00000100:00100000:2.0:1789672934.799470:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:12380:x1876607714284800:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672934.799495:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672934.799515:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965d0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2529d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.799603:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965d0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2529d expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.799620:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965d0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2529d expref: 68 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.799686:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cfc61501800) 00010000:00010000:2.0:1789672934.799691:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789672934.799695:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef400, rc 0) 00000100:00100000:2.0:1789672934.799750:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+68:12380:x1876607714284800:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 283us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672934.799758:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 193 00000100:00100000:0.0:1789672934.805855:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672934.805939:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714284928 00000100:00100000:1.0:1789672934.805950:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714284928 00000100:00100000:1.0:1789672934.806024:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:1.0:1789672934.806035:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+6:2395:x1876607714284928:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789672934.806249:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2395:x1876607714284928:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 216us (404us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789672934.806258:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00080000:0.0:1789672934.806918:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672934.815178:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672934.818859:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714285184 00000100:00100000:1.0:1789672934.818874:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714285184 00000100:00100000:1.0:1789672934.819802:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:1.0:1789672934.819817:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+68:12380:x1876607714285184:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789672934.820053:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+69:12380:x1876607714285184:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 240us (4885us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1789672934.820072:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:1.0:1789672934.825917:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672934.825960:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714285440 00000100:00100000:1.0:1789672934.825970:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714285440 00000100:00100000:1.0:1789672934.829615:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 194 00000100:00100000:1.0:1789672934.829634:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+69:12380:x1876607714285440:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789672934.829776:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+69:12380:x1876607714285440:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 149us (3869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672934.829784:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 194 00000100:00100000:2.0:1789672934.843763:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672934.843860:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714285568 00000100:00100000:1.0:1789672934.843871:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714285568 00000100:00100000:1.0:1789672934.843937:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 195 00000100:00100000:1.0:1789672934.843948:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+69:12380:x1876607714285568:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672934.843968:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672934.843988:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965d14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd252a4 expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.844062:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965d1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.844078:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965d1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.844089:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965d1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672934.844134:0:11081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789672934.844167:0:11081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965d1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.844193:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965d14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252a4 expref: 71 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.844209:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965d1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252a4 expref: 70 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.844218:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cfc61501800) 00010000:00010000:1.0:1789672934.844221:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789672934.844225:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435400, rc 0) 00000100:00100000:1.0:1789672934.844282:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+70:12380:x1876607714285568:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 336us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672934.844289:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 195 00000100:00100000:0.0:1789672934.848885:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672934.848950:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714285696 00000100:00100000:2.0:1789672934.848959:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714285696 00000100:00100000:2.0:1789672934.853540:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:2.0:1789672934.853561:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714285696:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672934.853583:0:8494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672934.853604:0:8494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0fd4e33/0x6c78c4f8c9965d22 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd252ab expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789672934.853632:0:8494:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac3de5, blocks: 0x0 00010000:00010000:2.0:1789672934.853669:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1789672934.853675:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672934.853684:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0fd4e33/0x6c78c4f8c9965d22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ab expref: 8 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.853702:0:8494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b0fd4e33/0x6c78c4f8c9965d22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ab expref: 8 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.853716:0:8494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef200, rc 0) 00000100:00100000:2.0:1789672934.853801:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2396:x1876607714285696:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 247us (4924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672934.853808:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:1.0:1789672934.861638:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672934.861697:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714285952 00000100:00100000:1.0:1789672934.861707:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714285952 00000100:00100000:1.0:1789672934.861765:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 196 00000100:00100000:1.0:1789672934.861775:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+70:12380:x1876607714285952:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789672934.861875:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+70:12380:x1876607714285952:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 102us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672934.861883:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 196 00000100:00100000:0.0:1789672934.866789:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672934.867685:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714286080 00000100:00100000:1.0:1789672934.867698:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714286080 00000100:00100000:1.0:1789672934.867764:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:1.0:1789672934.867774:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:12380:x1876607714286080:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672934.867802:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672934.867821:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d6f271f/0x6c78c4f8c9965d29 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd252b2 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.867853:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0fd4e33/0x6c78c4f8c9965d22 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ab expref: 9 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.867863:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672934.867867:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672934.867872:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d6f271f/0x6c78c4f8c9965d29 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252b2 expref: 9 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.867905:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0fd4e33/0x6c78c4f8c9965d22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ab expref: 9 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.867918:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0fd4e33/0x6c78c4f8c9965d22 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ab expref: 9 pid: 8494 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672934.867932:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8428:1876607738466048:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672934.868026:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc6155af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789672934.874453:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8428:1876607738466048:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789672934.874497:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d6f271f/0x6c78c4f8c9965d29 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252b2 expref: 9 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.874520:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434200, rc 0) 00000100:00100000:2.0:1789672934.874596:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:12380:x1876607714286080:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 6823us (7819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672934.874606:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:3.0:1789672934.878279:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672934.879055:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714286208 00000100:00100000:0.0:1789672934.879068:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714286208 00010000:00010000:0.0:1789672934.879499:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0fd4e33/0x6c78c4f8c9965d22 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ab expref: 9 pid: 8494 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672934.879924:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 88 00000100:00100000:0.0:1789672934.879937:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2395:x1876607714286208:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672934.879953:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672934.879992:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0fd4e33/0x6c78c4f8c9965d22 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ab expref: 9 pid: 8494 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.880008:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0fd4e33/0x6c78c4f8c9965d22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ab expref: 9 pid: 8494 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.880035:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0fd4e33/0x6c78c4f8c9965d22 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ab expref: 9 pid: 8494 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.880050:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672934.880054:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672934.880063:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d6f271f/0x6c78c4f8c9965d29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252b2 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.880072:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d6f271f/0x6c78c4f8c9965d29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252b2 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.880110:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006d6f271f/0x6c78c4f8c9965d29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252b2 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672934.880126:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6498:1876607738466176:192.168.201.50@tcp:105: 00000100:00100000:0.0:1789672934.880217:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d8059c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789672934.884432:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6498:1876607738466176:192.168.201.50@tcp:105: 00010000:00010000:3.0:1789672934.884468:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672934.884625:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2395:x1876607714286208:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 4690us (6352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672934.884651:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 88 00000100:00100000:3.0:1789672934.885108:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672934.885244:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714286336 00000100:00100000:2.0:1789672934.885254:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714286336 00002000:00100000:2.0:1789672934.885302:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8cfb479d1c00 x1876607714286336/t0(0) o4->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:560/0 lens 504/0 e 0 to 0 dl 1789672945 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789672934.885312:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfb479d1c00 with x1876607714286336 ext(0->8) 00002000:00010000:2.0:1789672934.885318:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfb479d1c00 00000100:00100000:2.0:1789672934.885347:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:2.0:1789672934.885356:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2395:x1876607714286336:12345-192.168.201.50@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789672934.887007:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+10:2395:x1876607714286336:12345-192.168.201.50@tcp:4:lhsmtool_posix.0 Request processed in 1645us (1894us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789672934.887020:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 4 00002000:00100000:2.0:1789672934.887031:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8cfb479d1c00 x1876607714286336/t4294967315(0) o4->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:560/0 lens 504/448 e 0 to 0 dl 1789672945 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789672934.887058:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfb479d1c00 with x1876607714286336 ext(0->8) 00002000:00010000:2.0:1789672934.887065:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfb479d1c00 00000100:00100000:3.0:1789672934.890161:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672934.890229:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714286464 00000100:00100000:0.0:1789672934.890240:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714286464 00000100:00100000:0.0:1789672934.890298:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 197 00000100:00100000:0.0:1789672934.890310:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+70:12380:x1876607714286464:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789672934.895310:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1789672934.895329:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:2.0:1789672934.895362:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1789672934.895407:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789672934.895416:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfc452923c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789672934.895422:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc49c67000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfc7d839e40 00000020:00080000:2.0:1789672934.895425:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc49c67700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cfb47bba200 00000020:00080000:2.0:1789672934.895477:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789672934.895688:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789672934.895811:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:12380:x1876607714286464:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 Request processed in 5499us (5657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672934.895820:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 197 00000100:00100000:3.0:1789672934.896085:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789672934.896100:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738466304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789672934.896149:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672934.896197:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738466304 00000100:00100000:3.0:1789672934.896204:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738466304 00000100:00100000:3.0:1789672934.896253:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789672934.896262:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738466304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789672934.896382:0:8494:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789672934.896386:0:8494:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789672933 00002000:00010000:3.0:1789672934.896388:0:8494:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789672934.896391:0:8494:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789672933 -> 1789672933 00002000:00010000:3.0:1789672934.896394:0:8494:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789672934.896426:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1876607738466304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (277us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789672934.896433:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:3.0:1789672934.896482:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfb479d3100/2, rc 0, transno 4294967316 00000100:00100000:3.0:1789672934.896487:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738466304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789672934.896832:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789672934.896843:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738466432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789672934.896875:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672934.896906:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738466432 00000100:00100000:1.0:1789672934.896910:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738466432 00000100:00100000:1.0:1789672934.896946:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789672934.896967:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1876607738466432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789672934.896984:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:1.0:1789672934.897014:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aac3de2, atime: 0x6aac3de2, ctime: 0x6aac3de2, blocks: 0x8 00010000:00010000:1.0:1789672934.897023:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965d30 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.897039:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1789672934.897044:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672934.897050:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965d30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.897068:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965d30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.897078:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965d30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.897086:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965d30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.897105:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789672934.897351:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3636:x1876607738466432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 383us (474us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789672934.897359:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:1.0:1789672934.897381:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672934.897387:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965d30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.897406:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0a00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789672934.897410:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965d30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.897420:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965d30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.897435:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965d30 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.897452:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000970f90e1/0x6c78c4f8c9965d30 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.897471:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672934.897472:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672934.897474:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789672934.898697:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfc7d93bb80/2, rc 0, transno 4294967308 00000100:00100000:2.0:1789672934.898708:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738466432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789672934.898857:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00010000:00010000:0.0:1789672934.899060:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965a51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899072:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965a51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899080:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965a51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899085:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aeee00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672934.899090:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965a51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899097:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965a51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899111:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cfc4991c400) 00010000:00010000:0.0:1789672934.899115:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672934.899119:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965a51 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899126:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965a51 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899146:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965a58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899151:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965a58 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899156:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965a58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899173:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672934.899177:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965a58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899183:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965a58 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899191:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:0.0:1789672934.899193:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672934.899197:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965a58 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899202:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886000/0x6c78c4f8c9965a58 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899216:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965a97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899221:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965a97 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899227:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965a97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899232:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672934.899234:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965a97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899240:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965a97 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899257:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb419b1f00) 00010000:00010000:0.0:1789672934.899260:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672934.899263:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965a97 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899270:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886200/0x6c78c4f8c9965a97 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899299:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899305:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b9a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899310:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899315:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672934.899317:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899322:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b9a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899329:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:0.0:1789672934.899331:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672934.899334:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b9a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899339:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965b9a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899361:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965bbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899366:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965bbd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899372:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965bbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899377:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672934.899379:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965bbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899385:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965bbd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899392:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:0.0:1789672934.899394:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672934.899396:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965bbd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899401:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965bbd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899409:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965c03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899415:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965c03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899420:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965c03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899430:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672934.899433:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965c03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899438:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965c03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899458:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:0.0:1789672934.899460:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672934.899463:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965c03 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899468:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965c03 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899480:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965d06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899485:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965d06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899490:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965d06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899495:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672934.899497:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965d06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899502:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965d06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899518:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cfc61501800) 00010000:00010000:0.0:1789672934.899520:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789672934.899730:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965d06 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.899737:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965d06 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672934.900039:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714286592 00000100:00100000:3.0:1789672934.900048:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714286592 00000100:00100000:3.0:1789672934.900131:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:3.0:1789672934.900141:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+10:2395:x1876607714286592:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789672934.901921:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1789672934.901944:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1789672934.902092:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2395:x1876607714286592:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 Request processed in 1947us (3232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672934.902104:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:2.0:1789672934.909639:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672934.909856:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714286848 00000100:00100000:0.0:1789672934.909867:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714286848 00000100:00100000:0.0:1789672934.909976:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 198 00000100:00100000:0.0:1789672934.909987:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7dac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:12380:x1876607714286848:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789672934.910048:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672934.910076:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965d1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252a4 expref: 19 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.910096:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cfc61501800) 00010000:00010000:0.0:1789672934.910101:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672934.910130:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965d37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.910144:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965d37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.910158:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965d37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789672934.910287:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfda4ba2 reply state 000000007531b06d transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965d37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.910320:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965d37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.910326:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cfc61501800) 00010000:00010000:0.0:1789672934.910328:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789672934.910331:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789672934.910438:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7dac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:12380:x1876607714286848:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 453us (809us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1789672934.910459:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 198 00000100:00100000:3.0:1789672934.912837:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672934.912940:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714286976 00000100:00100000:1.0:1789672934.912950:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714286976 00000100:00100000:1.0:1789672934.913000:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:1.0:1789672934.913009:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714286976:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789672934.913143:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789672934.913147:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789672933 -> 1789672932 00002000:00010000:1.0:1789672934.913150:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789672930 00002000:00010000:1.0:1789672934.913152:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789672933 -> 1789672932 00002000:00010000:1.0:1789672934.913166:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789672934.913236:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2396:x1876607714286976:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 227us (406us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789672934.913243:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:2.0:1789672934.916065:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672934.916187:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714287232 00000100:00100000:1.0:1789672934.916196:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714287232 00000100:00100000:1.0:1789672934.916287:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 199 00000100:00100000:1.0:1789672934.916298:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:12380:x1876607714287232:12345-192.168.201.50@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789672934.916374:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965d3e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.916392:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965cff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25296 expref: 20 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.916401:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965d3e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.916439:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965cff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25296 expref: 20 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.916465:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965cff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25296 expref: 20 pid: 9524 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672934.916480:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876607738466560:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672934.916587:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc6155af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789672934.920513:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672934.920764:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714287360 00000100:00100000:3.0:1789672934.920775:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714287360 00010000:00010000:3.0:1789672934.920816:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965cff lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25296 expref: 21 pid: 9524 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672934.920859:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 89 00000100:00100000:3.0:1789672934.920870:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f868850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:2396:x1876607714287360:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672934.920884:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672934.920892:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965cff lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25296 expref: 21 pid: 9524 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.920906:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965cff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25296 expref: 21 pid: 9524 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.920930:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cfc61501800) 00010000:00010000:3.0:1789672934.920936:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965d3e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.920946:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965d3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.920953:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965d3e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.920974:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672934.921030:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f868850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:2396:x1876607714287360:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 162us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672934.921055:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 89 00010000:00010000:1.0:1789672934.921766:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965cff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25296 expref: 20 pid: 9524 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672934.921798:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6513:1876607738466560:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672934.921820:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965d3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.921920:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965d3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.921937:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965d3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.921978:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965d3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.921985:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965d3e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.921991:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965d3e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.921997:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672934.922001:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965d3e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.922009:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965d3e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.922021:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cfc61501800) 00010000:00010000:2.0:1789672934.922023:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789672934.922027:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965d3e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.922032:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965d3e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672934.922131:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:12380:x1876607714287232:12345-192.168.201.50@tcp:55:lhsmtool_posix.0 Request processed in 5835us (6073us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789672934.922140:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 199 00000100:00100000:2.0:1789672934.930233:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672934.930391:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714287488 00000100:00100000:3.0:1789672934.930400:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714287488 00000100:00100000:3.0:1789672934.930463:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:3.0:1789672934.930474:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2397:x1876607714287488:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789672934.930517:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c9965d45 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.930811:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d6f271f/0x6c78c4f8c9965d29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252b2 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.930821:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672934.930826:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672934.930830:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c9965d45 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.930863:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d6f271f/0x6c78c4f8c9965d29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252b2 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.930877:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d6f271f/0x6c78c4f8c9965d29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252b2 expref: 8 pid: 8428 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672934.930890:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876607738466688:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672934.930978:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bba0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672934.933104:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876607738466688:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789672934.933133:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c9965d45 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672934.934411:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672934.936829:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714287616 00000100:00100000:0.0:1789672934.936845:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714287616 00010000:00010000:0.0:1789672934.936895:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d6f271f/0x6c78c4f8c9965d29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252b2 expref: 9 pid: 8428 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672934.936996:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 90 00000100:00100000:0.0:1789672934.937006:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2395:x1876607714287616:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672934.937023:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672934.937045:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d6f271f/0x6c78c4f8c9965d29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252b2 expref: 9 pid: 8428 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.937058:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d6f271f/0x6c78c4f8c9965d29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252b2 expref: 9 pid: 8428 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.937099:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d6f271f/0x6c78c4f8c9965d29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252b2 expref: 9 pid: 8428 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.937116:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789672934.937120:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789672934.937127:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c9965d45 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.937136:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c9965d45 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672934.937173:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672934.937231:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2395:x1876607714287616:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 226us (2824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672934.937238:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 90 00010000:00010000:1.0:1789672934.937294:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c9965d45 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.937307:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c9965d45 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.937326:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c9965d45 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.937334:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c9965d45 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.937342:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c9965d45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.937358:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4000 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789672934.937363:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c9965d45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.937371:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c9965d45 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.937406:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c9965d45 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.937414:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c9965d45 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672934.937469:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d869180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2397:x1876607714287488:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 Request processed in 6997us (7246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672934.937477:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:3.0:1789672934.940973:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672934.941085:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714287872 00000100:00100000:2.0:1789672934.941094:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714287872 00000100:00100000:2.0:1789672934.941170:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 200 00000100:00100000:2.0:1789672934.941180:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:12380:x1876607714287872:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789672934.941261:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965d4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.941278:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965b93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2523b expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.941771:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965d4c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.941809:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965b93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2523b expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.941823:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965b93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2523b expref: 19 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672934.941837:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d869c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738466816:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789672934.941964:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc44cc1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672934.945086:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672934.945263:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714288000 00000100:00100000:3.0:1789672934.945272:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714288000 00010000:00010000:3.0:1789672934.945319:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965b93 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2523b expref: 20 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672934.945367:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 91 00000100:00100000:3.0:1789672934.945377:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:2396:x1876607714288000:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672934.945391:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672934.945403:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965b93 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2523b expref: 20 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.945416:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965b93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2523b expref: 20 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.945436:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:3.0:1789672934.945453:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965d4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.945463:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965d4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.945470:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965d4c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.945489:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672934.945682:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:2396:x1876607714288000:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 280us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672934.945690:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 91 00010000:00010000:1.0:1789672934.946239:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965b93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2523b expref: 19 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672934.946258:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d869c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738466816:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672934.946280:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965d4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.946288:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965d4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.946294:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965d4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.946492:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d53 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.946505:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965d0d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2529d expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.946827:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d53 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.946861:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965d0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2529d expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.946876:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965d0d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2529d expref: 19 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672934.946891:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738466944:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672934.946954:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4a537900 going to sleep for 11 seconds 00000100:00100000:0.0:1789672934.951226:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672934.951307:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714288128 00000100:00100000:3.0:1789672934.951333:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714288128 00010000:00010000:3.0:1789672934.951397:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965d0d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2529d expref: 20 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672934.951452:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 92 00000100:00100000:3.0:1789672934.951465:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:2395:x1876607714288128:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672934.951484:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672934.951492:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965d0d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2529d expref: 20 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.951506:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965d0d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2529d expref: 20 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.951546:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cfc61501800) 00010000:00010000:3.0:1789672934.951553:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d53 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.951563:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.951573:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d53 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.951840:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672934.951917:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:2395:x1876607714288128:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 453us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672934.951927:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 92 00010000:00010000:1.0:1789672934.952466:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c9965d0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2529d expref: 19 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672934.952485:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738466944:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672934.952508:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.952517:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.952522:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789672934.952923:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1789672934.953050:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1789672934.953087:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1789672934.953188:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1876607738467072:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789672934.953248:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672934.953273:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb419de600 going to sleep for 11 seconds 00000100:00100000:2.0:1789672934.953397:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738467072 00000100:00100000:2.0:1789672934.953404:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738467072 00000100:00100000:2.0:1789672934.953462:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789672934.953471:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1876607738467072:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789672934.953568:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1876607738467072:12345-0@lo:1000:mdt00_002.0 Request processed in 98us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672934.953590:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789672934.953989:0:6514:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1789672934.953995:0:6514:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfb479d3100, transno 4294967316 00000100:00100000:1.0:1789672934.954015:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1876607738467072:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789672934.954124:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1789672934.954168:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1876607738467200:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789672934.954198:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672934.954214:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789672934.954354:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738467200 00000100:00100000:2.0:1789672934.954360:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738467200 00000100:00100000:2.0:1789672934.954399:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789672934.954406:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1876607738467200:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789672934.954515:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6514:x1876607738467200:12345-0@lo:1000:mdt00_002.0 Request processed in 109us (316us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789672934.954521:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789672934.954903:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6514:1876607738467200:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789672934.954936:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d53 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.954944:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d53 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.954951:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d53 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.954957:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a1a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672934.954961:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d53 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.954969:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d53 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.954984:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cfc61501800) 00010000:00010000:1.0:1789672934.954986:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672934.955002:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d53 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.955008:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d53 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.955028:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965c88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.955034:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965c88 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.955039:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965c88 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.955043:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672934.955046:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965c88 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.955051:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965c88 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.955058:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:1.0:1789672934.955060:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672934.955062:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965c88 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.955067:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965c88 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.955087:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d5a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.955099:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ca4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25281 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.955113:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d5a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.955137:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25281 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.955149:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25281 expref: 22 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672934.955161:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738467328:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672934.955227:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789672934.959366:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672934.959494:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714288256 00000100:00100000:3.0:1789672934.959507:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714288256 00010000:00010000:3.0:1789672934.959593:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ca4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25281 expref: 23 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672934.959640:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 93 00000100:00100000:3.0:1789672934.959650:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+23:2396:x1876607714288256:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672934.959688:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672934.959695:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ca4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25281 expref: 23 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.959708:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25281 expref: 23 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.959730:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:3.0:1789672934.959736:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d5a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.959746:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d5a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.959753:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d5a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.959773:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789672934.960054:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ca4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25281 expref: 23 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672934.960071:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738467328:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672934.960092:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d5a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.960101:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d5a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.960106:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d5a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.960120:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d5a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.960126:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d5a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.960141:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d5a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.960147:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672934.960151:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d5a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.960159:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d5a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.960168:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:1.0:1789672934.960170:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672934.960174:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d5a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.960180:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d5a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.960203:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965d4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.960210:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965d4c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.960216:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965d4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.960221:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aef800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672934.960224:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965d4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.960238:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965d4c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.960246:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc4991c600) 00010000:00010000:1.0:1789672934.960249:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789672934.960251:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965d4c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.960256:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965d4c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789672934.960508:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789672934.960512:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789672934.961007:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1789672934.961017:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789672934.962143:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:2396:x1876607714288256:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 2487us (2779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672934.962155:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 93 00000100:00100000:1.0:1789672934.963263:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:12380:x1876607714287872:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 22078us (22293us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789672934.963275:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 200 00000020:00080000:1.0:1789672934.963279:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789672934.965709:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672934.965975:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714288512 00000100:00100000:1.0:1789672934.965985:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714288512 00000100:00100000:1.0:1789672934.966040:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:1.0:1789672934.966050:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f851050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:12380:x1876607714288512:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789672934.966300:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789672934.966331:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1789672934.966367:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965d61 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.966384:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965d61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.966406:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965d61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.966433:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965d61 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.966439:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965d61 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.966453:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965d61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672934.966619:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789672934.966739:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f851050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+23:12380:x1876607714288512:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 689us (1039us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789672934.966748:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 50 00000020:00080000:1.0:1789672934.966753:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789672934.973116:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672934.973132:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965d61 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.973144:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a1000 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789672934.973148:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965d61 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.973159:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965d61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.973179:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cfc61501800) 00010000:00010000:2.0:1789672934.973182:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789672934.973186:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965d61 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672934.973341:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1000/0x6c78c4f8c9965d61 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672934.973813:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672934.973816:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672934.973819:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672935.235989:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb479d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738467456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672935.236073:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672935.236080:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738467584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789672935.236108:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672935.236149:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738467456 00000100:00100000:0.0:1789672935.236158:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738467456 00000100:00100000:1.0:1789672935.236181:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738467584 00000100:00100000:1.0:1789672935.236185:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738467584 00000100:00100000:0.0:1789672935.236228:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789672935.236239:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1876607738467456:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789672935.236252:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789672935.236278:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1789672935.236549:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1876607738467456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 312us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672935.236557:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789672935.237174:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789672935.237186:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738467584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789672935.237201:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1789672935.237261:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738467584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672935.237267:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789672935.237495:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738467584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789672935.239093:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb479d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738467456:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789672935.622983:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672936.260176:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672936.260200:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738467712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789672936.260266:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672936.260475:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738467712 00000100:00100000:1.0:1789672936.260483:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738467712 00000100:00100000:1.0:1789672936.260536:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789672936.260546:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738467712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789672936.260578:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789672936.260628:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738467712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672936.260648:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789672936.260711:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738467712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672936.403141:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672936.403192:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672936.403229:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672936.403254:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672936.403277:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672936.403297:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672936.403321:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672936.403348:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714288768 00000100:00100000:1.0:1789672936.403357:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714288768 00000100:00100000:1.0:1789672936.403413:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714288896 00000100:00100000:1.0:1789672936.403427:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714288896 00000100:00100000:1.0:1789672936.403442:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714289280 00000100:00100000:1.0:1789672936.403445:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714289280 00000100:00100000:1.0:1789672936.403456:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714289408 00000100:00100000:1.0:1789672936.403458:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714289408 00000100:00100000:1.0:1789672936.403475:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 339 00000100:00100000:1.0:1789672936.403484:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+23:2396:x1876607714288768:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672936.403569:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+23:2396:x1876607714288768:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 75us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672936.403576:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 339 00000100:00100000:1.0:1789672936.403595:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 340 00000100:00100000:1.0:1789672936.403602:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714288896:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672936.403626:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2396:x1876607714288896:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672936.403648:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 340 00000100:00100000:1.0:1789672936.403682:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 341 00000100:00100000:1.0:1789672936.403689:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714289280:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672936.403729:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714289280:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 41us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672936.403735:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 341 00000100:00100000:1.0:1789672936.403747:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 342 00000100:00100000:1.0:1789672936.403753:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714289408:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672936.403773:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714289408:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 20us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672936.403778:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 342 00000100:00100000:1.0:1789672936.403795:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714289024 00000100:00100000:1.0:1789672936.403798:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714289024 00000100:00100000:1.0:1789672936.403820:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714289152 00000100:00100000:1.0:1789672936.403822:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714289152 00000100:00100000:1.0:1789672936.403838:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 124 00000100:00100000:1.0:1789672936.403843:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4824e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714289024:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672936.403863:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4824e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714289024:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 19us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672936.403869:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 124 00000100:00100000:1.0:1789672936.403878:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 125 00000100:00100000:1.0:1789672936.403882:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714289152:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672936.403897:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714289152:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 15us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672936.403908:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 125 00000100:00080000:1.0:1789672936.403930:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789672936.403934:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672936.403936:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789672936.403938:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672936.404360:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714288640 00000100:00100000:0.0:1789672936.404366:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714288640 00000100:00100000:0.0:1789672936.404398:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 394 00000100:00100000:0.0:1789672936.404405:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2396:x1876607714288640:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672936.404446:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2396:x1876607714288640:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 42us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672936.404453:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 394 00000040:00080000:3.0:1789672936.509372:0:14704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672936.509383:0:14704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789672936.509408:0:14704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789672936.509427:0:14704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789672936.646805:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672936.680011:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672936.680134:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714289664 00000100:00100000:1.0:1789672936.680145:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714289664 00000100:00100000:1.0:1789672936.680213:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 201 00000100:00100000:1.0:1789672936.680223:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+23:12399:x1876607714289664:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789672936.680245:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672936.680265:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd252b9 expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.680393:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d6f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.680421:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d6f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.680434:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d6f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672936.680446:0:11081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789672936.680539:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965d68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252b9 expref: 26 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.680555:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252b9 expref: 25 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.680578:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:1.0:1789672936.680581:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789672936.680585:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a1a00, rc 0) 00000100:00100000:1.0:1789672936.680643:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:12399:x1876607714289664:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 422us (650us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789672936.680650:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 201 00000100:00100000:0.0:1789672936.691373:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672936.692744:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714289792 00000100:00100000:0.0:1789672936.692760:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714289792 00000100:00100000:0.0:1789672936.692815:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 202 00000100:00100000:0.0:1789672936.692826:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:12399:x1876607714289792:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:0.0:1789672936.692902:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965d7d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.692921:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965d7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.692934:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965d7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.692958:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.692966:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.692974:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693456:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965d8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693468:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693476:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789672936.693523:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693536:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965d7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693542:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965d7d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693548:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965d7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693554:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672936.693558:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965d7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693574:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965d7d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693586:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:0.0:1789672936.693589:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672936.693594:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965d7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693599:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965d7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693612:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693618:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693624:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693630:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672936.693632:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693637:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693830:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb478f1c00) 00010000:00010000:0.0:1789672936.693834:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672936.693838:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693854:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693869:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693875:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965d8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693881:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965d8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693885:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cda00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672936.693888:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965d8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693893:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965d8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693900:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfb478f1900) 00010000:00010000:0.0:1789672936.693902:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672936.693904:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965d8b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.693910:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965d8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672936.695098:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:12399:x1876607714289792:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 1172us (2634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672936.695287:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 202 00000100:00100000:1.0:1789672936.769338:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672936.769477:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714290048 00000100:00100000:0.0:1789672936.769488:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714290048 00000100:00100000:0.0:1789672936.769544:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 203 00000100:00100000:0.0:1789672936.769553:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:12402:x1876607714290048:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789672936.769575:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672936.769596:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965d92 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd252c0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.769703:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d99 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.769718:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.769730:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.769743:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965da0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.769750:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965da0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.769757:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965da0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.769929:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965da7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.769941:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965da7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.769950:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965da7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672936.769961:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789672936.770052:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d99 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.770060:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d99 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.770067:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.770072:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672936.770077:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.770084:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d99 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.770096:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:2.0:1789672936.770099:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672936.770245:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.770251:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965d99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.770266:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965da0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.770273:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965da0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.770279:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965da0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.770283:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672936.770286:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965da0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.770291:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965da0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.770298:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb478f1900) 00010000:00010000:2.0:1789672936.770301:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672936.770303:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965da0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.770309:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965da0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.770352:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965d92 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c0 expref: 28 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.770378:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965da7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c0 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672936.770385:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc45324000) 00010000:00010000:2.0:1789672936.770388:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672936.770390:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aeee00, rc 0) 00000100:00100000:2.0:1789672936.770476:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+27:12402:x1876607714290048:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 923us (1149us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789672936.770484:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 203 00000100:00100000:3.0:1789672936.778546:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672936.778645:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714290176 00000100:00100000:1.0:1789672936.778688:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714290176 00000100:00100000:1.0:1789672936.778742:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 204 00000100:00100000:1.0:1789672936.778751:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+27:12402:x1876607714290176:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:1.0:1789672936.778816:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965db5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.778832:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.778843:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.778878:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.778885:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965db5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.778893:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965db5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.778916:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672936.778933:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965db5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.778941:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965db5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.778952:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc45324000) 00010000:00010000:1.0:1789672936.778955:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672936.778960:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965db5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.778967:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965db5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672936.779040:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+27:12402:x1876607714290176:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 289us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672936.779047:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 204 00000100:00100000:0.0:1789672936.784353:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672936.784496:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714290432 00000100:00100000:1.0:1789672936.784507:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714290432 00000100:00100000:1.0:1789672936.784572:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:1.0:1789672936.784584:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+27:12402:x1876607714290432:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:1.0:1789672936.784892:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+28:12402:x1876607714290432:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 309us (548us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1789672936.784901:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:2.0:1789672936.846626:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672936.846696:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714290688 00000100:00100000:0.0:1789672936.846706:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714290688 00000100:00100000:0.0:1789672936.846795:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 205 00000100:00100000:0.0:1789672936.846805:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+28:11925:x1876607714290688:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789672936.846842:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672936.846861:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965dbc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd252c7 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.846956:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965dc3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.846969:0:9524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965da7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c0 expref: 29 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.846976:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965dc3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.847005:0:9524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965da7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c0 expref: 29 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.847016:0:9524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965da7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c0 expref: 29 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672936.847031:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876607738467840:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789672936.847154:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d839240 going to sleep for 11 seconds 00000100:00100000:0.0:1789672936.850375:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876607738467840:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789672936.850405:0:9524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965dc3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672936.858215:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672936.858590:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714290816 00000100:00100000:3.0:1789672936.858605:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714290816 00010000:00010000:3.0:1789672936.858700:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965da7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c0 expref: 30 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672936.858738:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 94 00000100:00100000:3.0:1789672936.858750:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+30:2396:x1876607714290816:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672936.858779:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672936.858786:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965da7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c0 expref: 30 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672936.858801:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965da7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c0 expref: 30 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672936.858824:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeee00/0x6c78c4f8c9965da7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c0 expref: 30 pid: 6514 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672936.858840:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc45324000) 00010000:00010000:3.0:1789672936.858859:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965dc3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672936.858870:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965dc3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672936.858878:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965dc3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672936.858910:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672936.858984:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d869c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+29:2396:x1876607714290816:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 236us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672936.858992:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 94 00010000:00010000:1.0:1789672936.859742:0:9524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965dc3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.859778:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965dc3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672936.859799:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789672936.860093:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965dbc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c7 expref: 30 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.860112:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965dc3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c7 expref: 29 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.860198:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc45324000) 00010000:00010000:1.0:1789672936.860201:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789672936.860205:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cca00, rc 0) 00000100:00100000:1.0:1789672936.860259:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+29:11925:x1876607714290688:12345-192.168.201.50@tcp:101:bash.0 Request processed in 13455us (13646us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1789672936.860267:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 205 00000100:00100000:1.0:1789672936.864319:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672936.864430:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714290944 00000100:00100000:0.0:1789672936.864442:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714290944 00000100:00100000:0.0:1789672936.864510:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 206 00000100:00100000:0.0:1789672936.864535:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+29:11925:x1876607714290944:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789672936.864559:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672936.864580:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965dd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd252ce expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.864614:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965dd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.864628:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.864639:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.864794:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965dd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ce expref: 31 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.864812:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ce expref: 30 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.864821:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc45324000) 00010000:00010000:0.0:1789672936.864824:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789672936.864828:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cda00, rc 0) 00000100:00100000:0.0:1789672936.864891:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+30:11925:x1876607714290944:12345-192.168.201.50@tcp:101:bash.0 Request processed in 357us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672936.864898:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 206 00000100:00100000:3.0:1789672936.869748:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672936.870206:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714291200 00000100:00100000:0.0:1789672936.870217:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714291200 00000100:00100000:0.0:1789672936.870311:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 207 00000100:00100000:0.0:1789672936.870340:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+30:11925:x1876607714291200:12345-192.168.201.50@tcp:36:bash.0 00010000:00010000:0.0:1789672936.870594:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965ddf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.870614:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965ddf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.870626:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965ddf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672936.870698:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1789672936.870723:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052bcb83d reply state 000000006d0d6baf transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965ddf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.870737:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965ddf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672936.870745:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc45324000) 00010000:00010000:0.0:1789672936.870747:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789672936.870752:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789672936.870831:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1789672936.870958:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+34:11925:x1876607714291200:12345-192.168.201.50@tcp:36:bash.0 Request processed in 622us (1219us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789672936.870966:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 207 00000020:00080000:0.0:1789672936.870971:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789672936.878927:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672936.879890:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714291328 00000100:00100000:1.0:1789672936.879903:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714291328 00000100:00100000:1.0:1789672936.879973:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 208 00000100:00100000:1.0:1789672936.879985:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+34:11925:x1876607714291328:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789672936.880012:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672936.880035:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965de6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd252d5 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.880101:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965de6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252d5 expref: 35 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.880138:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965de6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252d5 expref: 35 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.880158:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc45324000) 00010000:00010000:1.0:1789672936.880161:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672936.880165:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a0000, rc 0) 00000100:00100000:1.0:1789672936.880239:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+35:11925:x1876607714291328:12345-192.168.201.50@tcp:101:bash.0 Request processed in 256us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672936.880247:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 208 00000100:00100000:2.0:1789672936.887729:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672936.887807:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714291456 00000100:00100000:1.0:1789672936.887818:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714291456 00000100:00100000:1.0:1789672936.887882:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:1.0:1789672936.887893:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:11925:x1876607714291456:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789672936.887913:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672936.887937:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038e10c5d/0x6c78c4f8c9965ded lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd252dc expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789672936.887964:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aac3de4, atime: 0x6aac3de2, ctime: 0x6aac3de4, blocks: 0x8 00010000:00010000:1.0:1789672936.887989:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=414s v=(0 0) 00010000:00010000:1.0:1789672936.887994:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672936.888003:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038e10c5d/0x6c78c4f8c9965ded lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252dc expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.888021:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000038e10c5d/0x6c78c4f8c9965ded lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252dc expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672936.888055:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8a1000, rc 0) 00000100:00100000:1.0:1789672936.888124:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:11925:x1876607714291456:12345-192.168.201.50@tcp:101:bash.0 Request processed in 232us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672936.888131:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:3.0:1789672936.892051:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672936.894606:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714291584 00000100:00100000:0.0:1789672936.894623:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714291584 00002000:00010000:0.0:1789672936.894696:0:8435:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1789672936.894702:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfb479d0380 with x1876607714291584 ext(0->18446744073709551615) 00002000:00010000:0.0:1789672936.894715:0:8435:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfb479d0380. 00000100:00100000:0.0:1789672936.894817:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:0.0:1789672936.894841:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb479d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2398:x1876607714291584:12345-192.168.201.50@tcp:10:bash.0 00002000:00010000:0.0:1789672936.895100:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789672936.895104:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789672932 -> 1789672935 00002000:00010000:0.0:1789672936.895107:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789672930 -> 1789672930 00002000:00010000:0.0:1789672936.895109:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789672932 -> 1789672935 00002000:00010000:0.0:1789672936.895112:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789672936.895187:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb479d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2398:x1876607714291584:12345-192.168.201.50@tcp:10:bash.0 Request processed in 347us (3147us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789672936.895196:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 5 00002000:00010000:0.0:1789672936.895199:0:8435:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1789672936.895202:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfb479d0380 with x1876607714291584 ext(0->18446744073709551615) 00002000:00010000:0.0:1789672936.895207:0:8435:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfb479d0380. 00000100:00100000:3.0:1789672937.008704:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.008858:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714291712 00000100:00100000:1.0:1789672937.008869:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714291712 00000100:00100000:1.0:1789672937.008936:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 209 00000100:00100000:1.0:1789672937.008946:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+35:12416:x1876607714291712:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:1.0:1789672937.009027:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965df4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009045:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965df4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009058:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965df4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009075:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965dfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009082:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965dfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009089:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965dfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009179:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009201:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009210:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789672937.009262:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009273:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965df4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009280:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965df4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009287:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965df4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009294:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672937.009298:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965df4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009305:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965df4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009316:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:1.0:1789672937.009320:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672937.009325:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965df4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009331:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0a00/0x6c78c4f8c9965df4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009362:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965dfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009369:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965dfb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009376:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965dfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009381:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672937.009384:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965dfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009390:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965dfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009398:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfc61501000) 00010000:00010000:1.0:1789672937.009401:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672937.009404:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965dfb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009439:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965dfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009454:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009460:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009466:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009488:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672937.009492:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009497:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009506:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc45324000) 00010000:00010000:1.0:1789672937.009508:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672937.009511:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.009516:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672937.009881:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+35:12416:x1876607714291712:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 935us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672937.009890:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 209 00000100:00100000:2.0:1789672937.049639:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672937.049822:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714291968 00000100:00100000:0.0:1789672937.049833:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714291968 00000100:00100000:0.0:1789672937.049909:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 210 00000100:00100000:0.0:1789672937.050210:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+35:12419:x1876607714291968:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789672937.050235:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672937.050259:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965e09 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd252e3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.050347:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e10 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.050363:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.050374:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.050415:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.050424:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.050431:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.050548:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965e1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.050557:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965e1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.050824:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965e1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672937.050839:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789672937.050951:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.050960:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e10 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.050967:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.050973:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cce00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672937.050978:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.050998:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e10 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.051012:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:0.0:1789672937.051015:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672937.051020:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.051027:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.051040:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.051046:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e17 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.051051:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.051055:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672937.051058:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.051063:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e17 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.051070:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb478f1c00) 00010000:00010000:0.0:1789672937.051073:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672937.051076:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e17 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.051092:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.051269:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965e09 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252e3 expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.051287:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965e1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252e3 expref: 37 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.051296:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc45324000) 00010000:00010000:0.0:1789672937.051298:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789672937.051301:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cd200, rc 0) 00000100:00100000:0.0:1789672937.051506:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+37:12419:x1876607714291968:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 1586us (1877us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789672937.051514:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 210 00000100:00100000:0.0:1789672937.062749:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.063256:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714292096 00000100:00100000:1.0:1789672937.063267:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714292096 00000100:00100000:1.0:1789672937.063341:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 211 00000100:00100000:1.0:1789672937.063352:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+37:12419:x1876607714292096:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:1.0:1789672937.063432:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.063449:0:9524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965dc3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c7 expref: 37 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.063458:0:9524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e2c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.063507:0:9524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965dc3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c7 expref: 37 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.063521:0:9524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965dc3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c7 expref: 37 pid: 9524 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672937.063536:0:9524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876607738467968:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672937.063743:0:9524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687f300 going to sleep for 11 seconds 00000100:00100000:1.0:1789672937.071042:0:9524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9524:1876607738467968:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672937.071078:0:9524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672937.071821:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.072094:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714292352 00000100:00100000:1.0:1789672937.072102:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714292352 00000100:00100000:1.0:1789672937.072169:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:1.0:1789672937.072179:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+38:6168:x1876607714292352:12345-192.168.201.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789672937.072492:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+39:6168:x1876607714292352:12345-192.168.201.50@tcp:35:ldlm_bl.0 Request processed in 314us (673us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789672937.072501:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:3.0:1789672937.082073:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672937.083708:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714292480 00000100:00100000:2.0:1789672937.083722:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714292480 00010000:00010000:2.0:1789672937.083781:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965dc3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c7 expref: 39 pid: 9524 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672937.083826:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 95 00000100:00100000:2.0:1789672937.083837:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+39:2395:x1876607714292480:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672937.083852:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672937.083859:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965dc3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c7 expref: 39 pid: 9524 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.083872:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965dc3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c7 expref: 39 pid: 9524 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.083909:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965dc3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252c7 expref: 39 pid: 9524 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.083926:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc45324000) 00010000:00010000:2.0:1789672937.083932:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.083942:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.083949:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e2c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.083983:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672937.084037:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+38:2395:x1876607714292480:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 201us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672937.084045:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 95 00010000:00010000:1.0:1789672937.084853:0:9524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.084866:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.084905:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.084922:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.084928:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.084934:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672937.084938:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.084946:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.084959:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc45324000) 00010000:00010000:1.0:1789672937.084961:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672937.084966:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e2c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.084972:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672937.085044:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+37:12419:x1876607714292096:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 21693us (22305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672937.085052:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 211 00000100:00100000:3.0:1789672937.087042:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.087123:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714292736 00000100:00100000:1.0:1789672937.087134:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714292736 00000100:00100000:1.0:1789672937.087416:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:1.0:1789672937.087428:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+37:12419:x1876607714292736:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:1.0:1789672937.087681:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+38:12419:x1876607714292736:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 232us (625us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1789672937.087704:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:0.0:1789672937.161484:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672937.161783:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714292992 00000100:00100000:2.0:1789672937.161797:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714292992 00000100:00100000:2.0:1789672937.161879:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 212 00000100:00100000:2.0:1789672937.161892:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+38:12430:x1876607714292992:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:2.0:1789672937.161926:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672937.161956:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965e33 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd252ea expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.162056:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e3a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.162098:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.162116:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.162135:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.162143:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.162151:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163141:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965e48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163163:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965e48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163173:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965e48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672937.163186:0:11081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789672937.163695:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163707:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e3a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163715:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163737:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aefe00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672937.163743:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163752:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e3a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163768:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:2.0:1789672937.163771:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672937.163777:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163784:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163803:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163810:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163818:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163823:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aee200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672937.163826:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163834:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163853:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfc45324d00) 00010000:00010000:2.0:1789672937.163856:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672937.163860:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e41 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163867:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163931:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965e33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ea expref: 41 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163946:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965e48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ea expref: 40 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.163955:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc45324000) 00010000:00010000:2.0:1789672937.163958:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672937.163960:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef800, rc 0) 00000100:00100000:2.0:1789672937.164139:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+40:12430:x1876607714292992:12345-192.168.201.50@tcp:101:cat.0 Request processed in 2249us (2671us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789672937.164150:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 212 00000100:00100000:3.0:1789672937.168965:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.169077:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714293248 00000100:00100000:1.0:1789672937.169092:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714293248 00000100:00100000:1.0:1789672937.169200:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:1.0:1789672937.169214:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+40:12430:x1876607714293248:12345-192.168.201.50@tcp:35:cat.0 00000100:00100000:1.0:1789672937.169717:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+41:12430:x1876607714293248:12345-192.168.201.50@tcp:35:cat.0 Request processed in 503us (765us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789672937.169726:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:3.0:1789672937.185816:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672937.185926:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714293504 00000100:00100000:0.0:1789672937.185938:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714293504 00000100:00100000:0.0:1789672937.186002:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 213 00000100:00100000:0.0:1789672937.186011:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+41:12431:x1876607714293504:12345-192.168.201.50@tcp:36:rm.0 00010000:00010000:0.0:1789672937.186080:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789672937.186115:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0000/0x6c78c4f8c9965de6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252d5 expref: 41 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186172:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965e48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ea expref: 40 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186186:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965e1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252e3 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186213:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965dd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ce expref: 38 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186225:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc45324000) 00010000:00010000:0.0:1789672937.186230:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672937.186260:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965e56 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186278:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965e56 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186290:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965e56 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186308:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186315:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186321:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186455:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965e64 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186464:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965e64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186471:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965e64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789672937.186840:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1789672937.186852:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 415102193205ns, next at 416102189779ns, rc = 0 00010000:00010000:0.0:1789672937.186909:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e6b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186918:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186926:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186935:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e6b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186941:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e6b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186948:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e6b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.186966:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672937.186988:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965e64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.187002:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965e64 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.187008:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965e64 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.187014:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cca00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672937.187019:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965e64 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.187028:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965e64 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.187037:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc45324000) 00010000:00010000:0.0:1789672937.187040:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789672937.187044:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965e64 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.187049:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9965e64 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.187067:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965e56 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.187073:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965e56 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.187078:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965e56 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.187084:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672937.187093:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965e56 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.187100:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965e56 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.187107:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:0.0:1789672937.187110:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672937.187113:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965e56 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.187119:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc600/0x6c78c4f8c9965e56 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789672937.187129:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fffc287c reply state 000000007b02fd87 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.187142:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.187148:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb478f1c00) 00010000:00010000:0.0:1789672937.187150:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789672937.187153:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789672937.187250:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+39:12431:x1876607714293504:12345-192.168.201.50@tcp:36:rm.0 Request processed in 1237us (1444us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789672937.187258:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 213 00010000:00010000:1.0:1789672937.187629:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789672937.187638:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e6b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.187646:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd600 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789672937.187649:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e6b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.187684:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e6b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.187696:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc45324000) 00010000:00010000:1.0:1789672937.187699:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789672937.187702:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e6b lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.187708:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd600/0x6c78c4f8c9965e6b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.187721:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672937.187723:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672937.187732:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672937.215135:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.215387:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714293760 00000100:00100000:1.0:1789672937.215414:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714293760 00000100:00100000:1.0:1789672937.215487:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 214 00000100:00100000:1.0:1789672937.215498:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+39:12437:x1876607714293760:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789672937.215535:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672937.215564:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e72 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd252f1 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.215852:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965e79 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.215871:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965e79 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.215886:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965e79 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.215925:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.215934:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.215942:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789672937.216542:0:9524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789672937.216746:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.216756:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.216761:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.216791:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965e79 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.216796:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965e79 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.216801:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965e79 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.216805:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aef200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672937.216809:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965e79 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.216825:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965e79 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.216836:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:2.0:1789672937.216838:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672937.216842:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965e79 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.216846:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965e79 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789672937.216857:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d4ba864 reply state 00000000b7477305 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.216866:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.216870:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb478f1c00) 00010000:00010000:2.0:1789672937.216872:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789672937.216875:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789672937.216905:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965e72 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f1 expref: 42 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.216916:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f1 expref: 41 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.216921:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc45324d00) 00010000:00010000:2.0:1789672937.216923:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672937.216924:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aefe00, rc 0) 00000100:00100000:2.0:1789672937.217232:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+42:12437:x1876607714293760:12345-192.168.201.50@tcp:101:bash.0 Request processed in 1692us (2070us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1789672937.217245:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 214 00000100:00100000:3.0:1789672937.221437:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.221583:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714293888 00000100:00100000:1.0:1789672937.221597:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714293888 00000100:00100000:1.0:1789672937.221717:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:1.0:1789672937.221728:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2395:x1876607714293888:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789672937.221752:0:8494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672937.221779:0:8494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c9965e95 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd252f8 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789672937.221811:0:8494:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789672937.221839:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=415s v=(0 0) 00010000:00010000:1.0:1789672937.221844:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672937.221855:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c9965e95 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f8 expref: 8 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.221877:0:8494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c9965e95 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f8 expref: 8 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.221894:0:8494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435600, rc 0) 00000100:00100000:1.0:1789672937.221982:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2395:x1876607714293888:12345-192.168.201.50@tcp:101:bash.0 Request processed in 256us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672937.221990:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:3.0:1789672937.225653:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.225854:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714294016 00000100:00100000:1.0:1789672937.225869:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714294016 00000100:00100000:1.0:1789672937.225952:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:1.0:1789672937.225965:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:12437:x1876607714294016:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:1.0:1789672937.225991:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672937.226015:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd252ff expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.226063:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c9965e95 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f8 expref: 9 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.226073:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672937.226079:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672937.226085:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ff expref: 9 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.226132:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c9965e95 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f8 expref: 9 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.226148:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c9965e95 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f8 expref: 9 pid: 8494 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672937.226166:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8428:1876607738468096:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672937.226315:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672937.229738:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672937.230016:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714294144 00000100:00100000:3.0:1789672937.230029:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714294144 00010000:00010000:3.0:1789672937.230097:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c9965e95 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f8 expref: 10 pid: 8494 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672937.230224:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 96 00000100:00100000:3.0:1789672937.230236:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f869050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+10:2395:x1876607714294144:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672937.230278:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672937.230310:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c9965e95 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f8 expref: 10 pid: 8494 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.230327:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c9965e95 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f8 expref: 10 pid: 8494 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.230361:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672937.230367:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672937.230377:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ff expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.230390:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ff expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.230448:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ff expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672937.230476:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd40e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6498:1876607738468224:192.168.201.50@tcp:105: 00000100:00100000:3.0:1789672937.230597:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc49918c00 going to sleep for 11 seconds 00010000:00010000:1.0:1789672937.231395:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c9965e95 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f8 expref: 10 pid: 8494 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672937.231431:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8428:1876607738468096:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672937.231571:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ff expref: 9 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.231589:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434a00, rc 0) 00000100:00100000:1.0:1789672937.231745:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:12437:x1876607714294016:12345-192.168.201.50@tcp:101:bash.0 Request processed in 5782us (6109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672937.231755:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:1.0:1789672937.233953:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd40e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6498:1876607738468224:192.168.201.50@tcp:105: 00010000:00010000:1.0:1789672937.233985:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672937.234036:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f869050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2395:x1876607714294144:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 3801us (4313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672937.234049:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 96 00000100:00100000:0.0:1789672937.241973:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672937.242107:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714294400 00000100:00100000:2.0:1789672937.242123:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714294400 00000100:00100000:2.0:1789672937.242210:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:2.0:1789672937.242222:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+42:12437:x1876607714294400:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:2.0:1789672937.242912:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+43:12437:x1876607714294400:12345-192.168.201.50@tcp:35:bash.0 Request processed in 688us (950us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789672937.242923:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:2.0:1789672937.283982:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789672937.284017:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738468352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789672937.284130:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672937.284368:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738468352 00000100:00100000:0.0:1789672937.284380:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738468352 00000100:00100000:0.0:1789672937.284494:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789672937.284506:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738468352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789672937.284624:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789672937.284711:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738468352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 207us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672937.284719:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789672937.284771:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738468352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789672937.353948:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.354114:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714294528 00000100:00100000:1.0:1789672937.354126:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714294528 00000100:00100000:1.0:1789672937.354189:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 215 00000100:00100000:1.0:1789672937.354202:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+43:12453:x1876607714294528:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789672937.354237:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672937.354266:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ea3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25306 expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.354381:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965eaa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.354432:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965eaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.354447:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965eaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672937.354622:0:11081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789672937.354627:0:11081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789672937.354653:0:11081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965eaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.354800:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ea3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25306 expref: 45 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.354824:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965eaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25306 expref: 44 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.354832:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:1.0:1789672937.354835:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672937.354839:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435400, rc 0) 00000100:00100000:1.0:1789672937.355093:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+44:12453:x1876607714294528:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 892us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672937.355103:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 215 00000100:00100000:3.0:1789672937.362767:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.362969:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714294784 00000100:00100000:1.0:1789672937.362984:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714294784 00000100:00100000:1.0:1789672937.363084:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 216 00000100:00100000:1.0:1789672937.363095:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+44:12453:x1876607714294784:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789672937.363123:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672937.363149:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965eb1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2530d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.363296:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965eb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.363311:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.363322:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672937.363332:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789672937.363471:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965eb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2530d expref: 47 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.363501:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2530d expref: 46 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.363510:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc45324d00) 00010000:00010000:1.0:1789672937.363513:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672937.363518:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434c00, rc 0) 00000100:00100000:1.0:1789672937.363603:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+46:12453:x1876607714294784:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 510us (854us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1789672937.363609:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 216 00000100:00100000:0.0:1789672937.366395:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672937.366526:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714295040 00000100:00100000:2.0:1789672937.366597:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714295040 00000100:00100000:2.0:1789672937.366690:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 217 00000100:00100000:2.0:1789672937.366699:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+46:12453:x1876607714295040:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789672937.366727:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672937.366749:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ec6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25314 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.367237:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9965ecd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.367259:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9965ecd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.367275:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9965ecd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672937.367314:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789672937.367463:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ec6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25314 expref: 49 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.367495:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9965ecd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25314 expref: 48 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.367505:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc45324d00) 00010000:00010000:2.0:1789672937.367508:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789672937.367512:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef600, rc 0) 00000100:00100000:2.0:1789672937.367775:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+48:12453:x1876607714295040:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 1075us (1394us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1789672937.367785:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 217 00000100:00100000:3.0:1789672937.368131:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.368217:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714295168 00000100:00100000:1.0:1789672937.368235:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714295168 00000100:00100000:1.0:1789672937.368289:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:1.0:1789672937.368299:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+48:2396:x1876607714295168:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672937.368319:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672937.368340:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965eb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2530d expref: 48 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.368356:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc45324d00) 00010000:00010000:1.0:1789672937.368360:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672937.368412:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+47:2396:x1876607714295168:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 115us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672937.368420:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:3.0:1789672937.379114:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.379197:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714295296 00000100:00100000:1.0:1789672937.379212:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714295296 00000100:00100000:1.0:1789672937.379281:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:1.0:1789672937.379291:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2396:x1876607714295296:12345-192.168.201.50@tcp:1:lfs.0 00010000:00010000:1.0:1789672937.379357:0:8494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965edb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.379378:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ff expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.379385:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672937.379390:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789672937.379394:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965edb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.379477:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ff expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.379565:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ff expref: 8 pid: 8428 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672937.379583:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8494:1876607738468480:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672937.380094:0:8494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672937.384643:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8494:1876607738468480:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789672937.384795:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00010000:00010000:1.0:1789672937.384945:0:8494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965edb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672937.385091:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714295424 00000100:00100000:2.0:1789672937.385101:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714295424 00002000:00100000:2.0:1789672937.385168:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8cfc7f679180 x1876607714295424/t0(0) o4->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:563/0 lens 504/0 e 0 to 0 dl 1789672948 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789672937.385181:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfc7f679180 with x1876607714295424 ext(0->8) 00010000:00010000:2.0:1789672937.385189:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ff expref: 9 pid: 8428 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.385206:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ff expref: 9 pid: 8428 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789672937.385215:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cfc7f679180 00000100:00100000:2.0:1789672937.385311:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:2.0:1789672937.385340:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2395:x1876607714295424:12345-192.168.201.50@tcp:4:lfs.0 00000100:00100000:2.0:1789672937.391170:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+11:2395:x1876607714295424:12345-192.168.201.50@tcp:4:lfs.0 Request processed in 3998us (4543us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789672937.391195:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 3 00002000:00100000:2.0:1789672937.391215:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8cfc7f679180 x1876607714295424/t4294967309(0) o4->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:563/0 lens 504/448 e 0 to 0 dl 1789672948 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789672937.391228:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfc7f679180 with x1876607714295424 ext(0->8) 00010000:00010000:2.0:1789672937.391242:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ff expref: 11 pid: 8428 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.391265:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ff expref: 11 pid: 8428 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789672937.391274:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cfc7f679180 00000001:00080000:1.0:1789672937.393719:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1789672937.393740:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:0.0:1789672937.397198:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672937.398770:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714295552 00000100:00100000:2.0:1789672937.398784:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714295552 00010000:00010000:3.0:1789672937.398924:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ff expref: 9 pid: 8428 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672937.399064:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 97 00000100:00100000:3.0:1789672937.399077:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2396:x1876607714295552:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672937.399096:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789672937.399119:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789672937.399121:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789672935 00002000:00010000:3.0:1789672937.399124:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789672935 00002000:00010000:3.0:1789672937.399125:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789672935 00002000:00010000:3.0:1789672937.399127:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789672937.399132:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ff expref: 9 pid: 8428 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.399144:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ff expref: 9 pid: 8428 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.399171:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000592a527b/0x6c78c4f8c9965e9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252ff expref: 9 pid: 8428 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.399193:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672937.399198:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672937.399205:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965edb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.399216:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965edb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.399273:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672937.399352:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2396:x1876607714295552:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 278us (2170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672937.399359:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 97 00010000:00010000:2.0:1789672937.399420:0:8494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965edb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.399428:0:8494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965edb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.399449:0:8494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965edb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.399454:0:8494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965edb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.399467:0:8494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965edb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.399472:0:8494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434c00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789672937.399475:0:8494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965edb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.399491:0:8494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965edb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.399504:0:8494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965edb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.399511:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee7f63cb/0x6c78c4f8c9965edb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672937.399572:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714295296:12345-192.168.201.50@tcp:1:lfs.0 Request processed in 20283us (20475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672937.399579:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:0.0:1789672937.403182:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672937.403331:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714295808 00000100:00100000:2.0:1789672937.403407:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714295808 00000100:00100000:2.0:1789672937.403622:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:2.0:1789672937.403637:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f852850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+47:12453:x1876607714295808:12345-192.168.201.50@tcp:35:lfs.0 00000004:00010000:2.0:1789672937.403755:0:6515:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9965ecd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25314 expref: 47 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789672937.404025:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1789672937.404069:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1789672937.405892:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1789672937.405980:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ee2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.406003:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f1 expref: 51 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.406013:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ee2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.406063:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f1 expref: 51 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.406081:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f1 expref: 51 pid: 9524 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672937.406098:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb46802d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1876607738468608:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789672937.406284:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bba0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789672937.410278:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672937.410425:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb46802d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6515:1876607738468608:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789672937.410462:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ee2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672937.410756:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714295936 00000100:00100000:1.0:1789672937.410767:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714295936 00010000:00010000:1.0:1789672937.410817:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f1 expref: 52 pid: 9524 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672937.410868:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 98 00000100:00100000:1.0:1789672937.410880:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+52:2395:x1876607714295936:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672937.410899:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672937.410906:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f1 expref: 52 pid: 9524 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.410944:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f1 expref: 52 pid: 9524 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.410973:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c9965e87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252f1 expref: 52 pid: 9524 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.410991:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc45324d00) 00010000:00010000:1.0:1789672937.410996:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ee2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.411008:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.411018:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ee2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.411054:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672937.411121:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+51:2395:x1876607714295936:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 242us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672937.411129:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 98 00010000:00010000:0.0:1789672937.411282:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.411291:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789672937.411642:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1789672937.411837:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1789672937.411951:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f678e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1876607738468736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789672937.412020:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672937.412499:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c604240 going to sleep for 11 seconds 00000100:00100000:2.0:1789672937.413891:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738468736 00000100:00100000:2.0:1789672937.413908:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738468736 00000100:00100000:2.0:1789672937.414036:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789672937.414049:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6515:x1876607738468736:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789672937.414298:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6515:x1876607738468736:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 251us (2277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672937.414307:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:1.0:1789672937.414742:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672937.414843:0:6515:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:3.0:1789672937.414851:0:6515:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:3.0:1789672937.414877:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfc7d93bb80, transno 4294967308 00000100:00100000:3.0:1789672937.414929:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f678e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1876607738468736:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789672937.415132:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1789672937.415236:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48076680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1876607738468864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789672937.415294:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672937.415334:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc411ca840 going to sleep for 11 seconds 00000100:00100000:0.0:1789672937.415478:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738468864 00000100:00100000:0.0:1789672937.415496:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738468864 00000100:00100000:0.0:1789672937.415555:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789672937.415565:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1876607738468864:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789672937.415743:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6515:x1876607738468864:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 179us (447us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789672937.415763:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789672937.415903:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48076680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6515:1876607738468864:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789672937.415955:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1789672937.416001:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.416014:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ee2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.416024:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ee2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.416031:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aeec00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672937.416037:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ee2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.416058:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ee2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.416078:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc45324d00) 00010000:00010000:3.0:1789672937.416081:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789672937.416088:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ee2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.416095:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c9965ee2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789672937.416222:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789672937.416301:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1789672937.416316:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 415331656520ns, next at 416331653700ns, rc = 0 00000001:00080000:3.0:1789672937.416323:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1789672937.416364:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc45324d00) 00010000:00010000:3.0:1789672937.416367:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789672937.416376:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9965ecd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25314 expref: 55 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672937.416516:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f852850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+54:12453:x1876607714295808:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 12883us (13348us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789672937.416526:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 56 00000020:00080000:3.0:1789672937.416531:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789672937.420199:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.420282:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714296064 00000100:00100000:1.0:1789672937.420294:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714296064 00000100:00100000:1.0:1789672937.420371:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 218 00000100:00100000:1.0:1789672937.420382:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+54:12453:x1876607714296064:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789672937.420420:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672937.420451:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ee9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2531b expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.420567:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2531b expref: 55 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.420586:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2531b expref: 55 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.420611:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672937.420615:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672937.420620:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435600, rc 0) 00000100:00100000:1.0:1789672937.420720:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+55:12453:x1876607714296064:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 339us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672937.420728:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 218 00000100:00100000:0.0:1789672937.424968:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.425098:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714296320 00000100:00100000:1.0:1789672937.425111:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714296320 00000100:00100000:1.0:1789672937.425225:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:1.0:1789672937.425238:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+55:12453:x1876607714296320:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:1.0:1789672937.425612:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+56:12453:x1876607714296320:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 376us (659us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789672937.425621:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:2.0:1789672937.514475:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672937.514646:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714296448 00000100:00100000:0.0:1789672937.514713:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714296448 00000100:00100000:0.0:1789672937.514796:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 219 00000100:00100000:0.0:1789672937.514809:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+56:12463:x1876607714296448:12345-192.168.201.50@tcp:34:lfs.0 00010000:00010000:0.0:1789672937.514921:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965ef0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.514945:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.514961:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.514974:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965ef7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.514982:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.514989:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515089:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965efe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515098:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965efe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515106:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965efe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789672937.515203:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965efe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515221:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515229:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965ef0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515238:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965ef0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515245:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8ccc00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672937.515250:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965ef0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515260:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965ef0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515275:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:0.0:1789672937.515278:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672937.515284:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965ef0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515291:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965ef0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515306:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515313:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965ef7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515327:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515334:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672937.515337:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515428:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515439:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb478f1c00) 00010000:00010000:0.0:1789672937.515442:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672937.515446:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965ef7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515452:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965ef7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515464:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965efe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515471:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965efe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515477:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965efe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515482:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672937.515486:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965efe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515503:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965efe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515511:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:0.0:1789672937.515513:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672937.515517:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965efe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.515522:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965efe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672937.515734:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+56:12463:x1876607714296448:12345-192.168.201.50@tcp:34:lfs.0 Request processed in 925us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672937.515744:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 219 00000100:00100000:2.0:1789672937.547153:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672937.547779:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714296704 00000100:00100000:0.0:1789672937.547796:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714296704 00000100:00100000:0.0:1789672937.547934:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 220 00000100:00100000:0.0:1789672937.547947:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+56:12466:x1876607714296704:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789672937.547978:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672937.548009:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965f05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25322 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548110:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965f0c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548130:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965f0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548146:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965f0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548179:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965f13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548188:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965f13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548329:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965f13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548701:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965f1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548713:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965f1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548721:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965f1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672937.548734:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789672937.548841:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965f0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548850:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965f0c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548857:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965f0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548865:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672937.548870:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965f0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548892:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965f0c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548908:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:0.0:1789672937.548912:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672937.548919:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965f0c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548925:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965f0c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548942:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965f13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548949:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965f13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548955:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965f13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548960:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8ccc00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672937.548963:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965f13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548970:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965f13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548977:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb478f1c00) 00010000:00010000:0.0:1789672937.548980:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672937.548983:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965f13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.548999:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8ccc00/0x6c78c4f8c9965f13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.549047:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965f05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25322 expref: 59 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.549062:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965f1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25322 expref: 58 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.549070:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:0.0:1789672937.549072:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789672937.549075:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cda00, rc 0) 00000100:00100000:0.0:1789672937.549503:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:12466:x1876607714296704:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 1556us (2363us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789672937.549513:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 220 00000100:00100000:0.0:1789672937.553951:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672937.554082:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714296832 00000100:00100000:3.0:1789672937.554096:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714296832 00000100:00100000:3.0:1789672937.554202:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 221 00000100:00100000:3.0:1789672937.554214:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:12466:x1876607714296832:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:3.0:1789672937.554328:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965f28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.554348:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965f28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.554375:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965f28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.554441:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965f28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.554451:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965f28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.554458:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965f28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.554465:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672937.554470:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965f28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.554478:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965f28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.554494:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:3.0:1789672937.554498:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789672937.554504:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965f28 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.554511:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965f28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672937.554793:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:12466:x1876607714296832:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 579us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672937.554802:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 221 00000100:00100000:2.0:1789672937.557317:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672937.557468:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714297088 00000100:00100000:3.0:1789672937.557481:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714297088 00000100:00100000:3.0:1789672937.557561:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:3.0:1789672937.557575:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb477a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+58:12466:x1876607714297088:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789672937.558049:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb477a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+59:12466:x1876607714297088:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 478us (745us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1789672937.558058:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:2.0:1789672937.637848:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672937.638026:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714297344 00000100:00100000:3.0:1789672937.638041:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714297344 00000100:00100000:3.0:1789672937.638119:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 222 00000100:00100000:3.0:1789672937.638131:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+59:12476:x1876607714297344:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789672937.638163:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672937.638167:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789672937.638213:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965eaa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25306 expref: 59 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.638236:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:3.0:1789672937.638242:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672937.638258:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965f2f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25329 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.638409:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965f36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.638445:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965f1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25322 expref: 59 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.638455:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965f36 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.638509:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965f1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25322 expref: 59 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.638526:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965f1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25322 expref: 59 pid: 9524 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672937.638881:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738468992:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672937.639018:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc411cae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789672937.643323:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672937.643454:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738468992:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789672937.643506:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965f36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672937.643591:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714297472 00000100:00100000:1.0:1789672937.643602:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714297472 00010000:00010000:1.0:1789672937.643651:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965f1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25322 expref: 60 pid: 9524 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672937.643727:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 99 00000100:00100000:1.0:1789672937.643739:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:2395:x1876607714297472:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672937.643777:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672937.643786:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965f1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25322 expref: 60 pid: 9524 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.643799:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965f1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25322 expref: 60 pid: 9524 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.643827:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965f1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25322 expref: 60 pid: 9524 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.643845:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672937.643850:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965f36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.643861:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965f36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.643870:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965f36 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.643908:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672937.643985:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+59:2395:x1876607714297472:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 247us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672937.643993:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 99 00010000:00010000:0.0:1789672937.644456:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965f36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.644465:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965f36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672937.644490:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789672937.644700:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c9965f2f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25329 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.644719:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965f36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25329 expref: 59 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.644737:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:0.0:1789672937.644740:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789672937.644743:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e4000, rc 0) 00000100:00100000:0.0:1789672937.644792:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+59:12476:x1876607714297344:12345-192.168.201.50@tcp:101:bash.0 Request processed in 6663us (6959us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1789672937.644800:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 222 00000100:00100000:0.0:1789672937.648952:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672937.649107:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714297600 00000100:00100000:2.0:1789672937.649120:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714297600 00000100:00100000:2.0:1789672937.649207:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 223 00000100:00100000:2.0:1789672937.649220:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5cf04450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+59:12476:x1876607714297600:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:2.0:1789672937.649254:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672937.649282:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965f44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25330 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.649325:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965f4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.649343:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965f4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.649357:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965f4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.649552:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965f44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25330 expref: 61 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.649574:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965f4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25330 expref: 60 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.649592:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:2.0:1789672937.649596:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789672937.649601:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef800, rc 0) 00000100:00100000:2.0:1789672937.649726:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5cf04450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:12476:x1876607714297600:12345-192.168.201.50@tcp:101:bash.0 Request processed in 508us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672937.649734:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 223 00000100:00100000:2.0:1789672937.659019:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672937.659167:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714297856 00000100:00100000:3.0:1789672937.659180:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714297856 00000100:00100000:3.0:1789672937.659490:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 224 00000100:00100000:3.0:1789672937.659504:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+60:12476:x1876607714297856:12345-192.168.201.50@tcp:36:bash.0 00010000:00010000:3.0:1789672937.659963:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965f52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.659987:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965f52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.660022:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965f52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789672937.660078:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1789672937.660107:0:6513:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067266feb reply state 0000000052cda834 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965f52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.660122:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965f52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.660130:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:3.0:1789672937.660133:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789672937.660139:0:6513:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789672937.660430:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:12476:x1876607714297856:12345-192.168.201.50@tcp:36:bash.0 Request processed in 927us (1425us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789672937.660439:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 224 00000020:00080000:3.0:1789672937.660446:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789672937.662989:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672937.663052:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714297984 00000100:00100000:3.0:1789672937.663065:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714297984 00000100:00100000:3.0:1789672937.663137:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 225 00000100:00100000:3.0:1789672937.663149:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:12476:x1876607714297984:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789672937.663183:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672937.663209:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965f59 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25337 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.663326:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.663413:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965f36 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25329 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.663443:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.664471:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965f36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25329 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.664621:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965f36 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25329 expref: 64 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672937.664641:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738469120:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672937.664991:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc411cae40 going to sleep for 11 seconds 00010000:00010000:3.0:1789672937.668001:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672937.668629:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672937.668791:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738469120:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789672937.668828:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672937.668914:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714298112 00000100:00100000:1.0:1789672937.668923:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714298112 00010000:00010000:1.0:1789672937.668968:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965f36 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25329 expref: 65 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672937.669091:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 100 00000100:00100000:1.0:1789672937.669103:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:2396:x1876607714298112:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672937.669123:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672937.669132:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965f36 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25329 expref: 65 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.669144:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965f36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25329 expref: 65 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.669170:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c9965f36 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25329 expref: 65 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.669200:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672937.669205:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.669217:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.669226:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.669257:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672937.669377:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.669385:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672937.669468:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789672937.669473:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789672937.669510:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.669560:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9965f59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25337 expref: 65 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.669586:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25337 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.669594:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:3.0:1789672937.669597:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789672937.669600:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e5800, rc 0) 00000100:00100000:1.0:1789672937.669870:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+64:2396:x1876607714298112:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 767us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672937.669880:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 100 00000100:00100000:3.0:1789672937.670108:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:12476:x1876607714297984:12345-192.168.201.50@tcp:101:bash.0 Request processed in 6961us (7129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672937.670116:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 225 00000100:00100000:2.0:1789672937.673902:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.673978:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714298368 00000100:00100000:1.0:1789672937.674009:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714298368 00000100:00100000:1.0:1789672937.674113:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:1.0:1789672937.674126:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+63:12476:x1876607714298368:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:1.0:1789672937.674801:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+64:12476:x1876607714298368:12345-192.168.201.50@tcp:35:bash.0 Request processed in 674us (909us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789672937.674812:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:0.0:1789672937.733790:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672937.733900:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714298496 00000100:00100000:2.0:1789672937.733913:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714298496 00000100:00100000:2.0:1789672937.733985:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 226 00000100:00100000:2.0:1789672937.733995:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+64:12482:x1876607714298496:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789672937.734031:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672937.734057:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965f67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2533e expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.734135:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c9965f6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.734151:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c9965f6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.734164:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c9965f6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672937.734356:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789672937.734361:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789672937.734418:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c9965f6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.734452:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef200/0x6c78c4f8c9965f67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2533e expref: 66 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.734472:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c9965f6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2533e expref: 65 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.734491:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:2.0:1789672937.734494:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789672937.734499:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee600, rc 0) 00000100:00100000:2.0:1789672937.734726:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:12482:x1876607714298496:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 731us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672937.734733:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 226 00000100:00100000:0.0:1789672937.738880:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.738966:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714298624 00000100:00100000:1.0:1789672937.738980:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714298624 00000100:00100000:1.0:1789672937.739052:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 227 00000100:00100000:1.0:1789672937.739066:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:12482:x1876607714298624:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789672937.739093:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672937.739119:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965f75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25345 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740112:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965f7c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740136:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965f7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740152:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965f7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740165:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965f83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740173:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965f83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740180:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965f83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740319:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965f8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740330:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965f8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740419:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965f8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672937.740606:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789672937.740612:0:6513:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789672937.740640:0:6513:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965f8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740654:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965f8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740737:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965f7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740745:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965f7c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740753:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965f7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740760:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672937.740765:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965f7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740774:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965f7c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740798:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:1.0:1789672937.740801:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672937.740808:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965f7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740815:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435000/0x6c78c4f8c9965f7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740832:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965f83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740839:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965f83 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740845:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965f83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740850:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672937.740853:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965f83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740860:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965f83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740867:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb478f1c00) 00010000:00010000:1.0:1789672937.740870:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672937.740873:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965f83 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740879:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c9965f83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740929:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965f75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25345 expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740945:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965f8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25345 expref: 66 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.740953:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672937.740956:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672937.740959:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434a00, rc 0) 00000100:00100000:1.0:1789672937.741104:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+66:12482:x1876607714298624:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 2039us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672937.741115:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 227 00000100:00100000:0.0:1789672937.744981:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.745085:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714298880 00000100:00100000:1.0:1789672937.745097:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714298880 00000100:00100000:1.0:1789672937.745176:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 228 00000100:00100000:1.0:1789672937.745188:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+66:12482:x1876607714298880:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789672937.745222:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672937.745250:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965f91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2534c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.745419:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.745437:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25337 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.745446:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965f8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25345 expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.745482:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.745525:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965f8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25345 expref: 67 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.745552:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965f8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25345 expref: 67 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672937.745568:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738469248:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672937.745745:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25337 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.745755:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25337 expref: 67 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672937.745765:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c406d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738469376:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672937.745790:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789672937.749274:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738469248:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672937.749294:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c406d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738469376:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672937.749331:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672937.750439:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.750753:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714299008 00000100:00100000:1.0:1789672937.750763:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714299008 00010000:00010000:1.0:1789672937.750834:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965f8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25345 expref: 68 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672937.750879:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 101 00000100:00100000:1.0:1789672937.750889:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+68:2398:x1876607714299008:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672937.750908:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672937.750916:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965f8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25345 expref: 68 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.750929:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965f8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25345 expref: 68 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.750958:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c9965f8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25345 expref: 68 pid: 6513 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.750980:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672937.750986:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.750997:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.751005:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672937.751069:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:2398:x1876607714299008:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 181us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672937.751077:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 101 00000100:00100000:2.0:1789672937.753741:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672937.754065:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714299136 00000100:00100000:3.0:1789672937.754078:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714299136 00010000:00010000:2.0:1789672937.754270:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25337 expref: 67 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672937.754357:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 102 00000100:00100000:2.0:1789672937.754367:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f86a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:2396:x1876607714299136:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789672937.754387:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672937.754407:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25337 expref: 67 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.754422:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25337 expref: 67 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.754468:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c9965f60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25337 expref: 67 pid: 6512 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.754498:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:2.0:1789672937.754503:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.754514:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.754522:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.754795:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672937.754875:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f86a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+66:2396:x1876607714299136:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 509us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672937.754885:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 102 00010000:00010000:3.0:1789672937.758277:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.758299:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672937.758334:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789672937.758807:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434c00/0x6c78c4f8c9965f91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2534c expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.758833:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2534c expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672937.758844:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:3.0:1789672937.758847:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789672937.758851:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434200, rc 0) 00000100:00100000:3.0:1789672937.759011:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+66:12482:x1876607714298880:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 13824us (14045us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789672937.759021:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 228 00000100:00100000:0.0:1789672937.762566:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672937.762876:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714299392 00000100:00100000:1.0:1789672937.762890:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714299392 00000100:00100000:1.0:1789672937.763063:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:1.0:1789672937.763076:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+66:12482:x1876607714299392:12345-192.168.201.50@tcp:103:lfs.0 00010000:00010000:1.0:1789672937.763095:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672937.763127:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965ee9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2531b expref: 66 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672937.763149:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672937.763156:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672937.763236:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:12482:x1876607714299392:12345-192.168.201.50@tcp:103:lfs.0 Request processed in 164us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672937.763244:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:2.0:1789672937.766147:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672937.766458:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714299520 00000100:00100000:0.0:1789672937.766592:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714299520 00000100:00100000:0.0:1789672937.766805:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 229 00000100:00100000:0.0:1789672937.766818:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:12482:x1876607714299520:12345-192.168.201.50@tcp:58:lfs.0 00010000:00010000:0.0:1789672937.766967:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965fa6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.766991:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965fa6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672937.767005:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965fa6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789672937.767160:0:9524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789672937.767333:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:12482:x1876607714299520:12345-192.168.201.50@tcp:58:lfs.0 Request processed in 517us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672937.767352:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 229 00000100:00100000:0.0:1789672937.769899:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672937.770004:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714299648 00000100:00100000:2.0:1789672937.770017:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714299648 00000100:00100000:2.0:1789672937.770092:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 230 00000100:00100000:2.0:1789672937.770105:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+65:12482:x1876607714299648:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789672937.770134:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672937.770163:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c9965fad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25353 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.770235:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965fa6 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.770266:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c9965fad lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25353 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.770290:0:6514:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965fa6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.770306:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c9965fad lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25353 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.770324:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:2.0:1789672937.770327:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789672937.770332:0:6514:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c9965fad lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25353 expref: 66 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672937.770341:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef000, rc 0) 00000100:00100000:2.0:1789672937.770428:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+66:12482:x1876607714299648:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 326us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672937.770436:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 230 00000040:00080000:2.0:1789672938.052071:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789672938.052089:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789672938.052221:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789672938.052243:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789672938.054796:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47abaa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1876607738469504:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789672938.055001:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bbad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789672938.065826:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672938.066286:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714299776 00000100:00100000:3.0:1789672938.066301:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714299776 00000100:00100000:3.0:1789672938.066423:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 231 00000100:00100000:3.0:1789672938.066440:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:12484:x1876607714299776:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789672938.066487:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789672938.066817:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:12484:x1876607714299776:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 382us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672938.066827:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 231 00000100:00080000:1.0:1789672938.066904:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672938.070735:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672938.070907:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714299904 00000100:00100000:0.0:1789672938.070923:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714299904 00000100:00100000:0.0:1789672938.071018:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 232 00000100:00100000:0.0:1789672938.071031:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:12484:x1876607714299904:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789672938.071139:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965fb4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071162:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071179:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071199:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965fbb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071208:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965fbb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071216:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965fbb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071251:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965fc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071286:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071294:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789672938.071376:0:9524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789672938.071382:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789672938.071411:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071423:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071431:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965fb4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071439:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965fb4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071446:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672938.071452:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965fb4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071461:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965fb4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071475:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfc61501100) 00010000:00010000:0.0:1789672938.071478:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672938.071484:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965fb4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071501:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc000/0x6c78c4f8c9965fb4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071520:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965fbb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071538:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965fbb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071545:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965fbb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071550:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672938.071553:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965fbb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071560:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965fbb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071569:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8cfb478f1000) 00010000:00010000:0.0:1789672938.071571:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672938.071574:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965fbb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071579:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965fbb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071596:0:9524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071602:0:9524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965fc2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071614:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071620:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cda00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789672938.071623:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071629:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965fc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071637:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:0.0:1789672938.071639:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789672938.071642:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965fc2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.071648:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965fc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672938.074005:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47abaa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1876607738469504:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789672938.076508:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+66:12484:x1876607714299904:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 Request processed in 5463us (5773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672938.076528:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 232 00000100:00100000:0.0:1789672938.081310:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672938.081423:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714300160 00000100:00100000:1.0:1789672938.081437:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714300160 00000100:00100000:1.0:1789672938.081523:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 233 00000100:00100000:1.0:1789672938.081548:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+66:12484:x1876607714300160:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672938.081577:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672938.081606:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965fc9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2535a expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.081793:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965fd0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.081812:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.081823:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789672938.081853:0:11081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789672938.081945:0:11081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.081951:0:11081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965fd0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.081957:0:11081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.081961:0:11081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672938.081964:0:11081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.081970:0:11081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965fd0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.081980:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672938.081983:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789672938.081987:0:11081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965fd0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.081992:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434600/0x6c78c4f8c9965fd0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.082031:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965fc9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2535a expref: 68 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.082038:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfc61501100) 00010000:00010000:1.0:1789672938.082039:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789672938.082047:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9965fc9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2535a expref: 68 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.082055:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435600, rc 0) 00000100:00100000:1.0:1789672938.082124:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:12484:x1876607714300160:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 581us (830us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1789672938.082132:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 233 00000100:00100000:0.0:1789672938.088560:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672938.088831:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714300288 00000100:00100000:1.0:1789672938.088844:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714300288 00000100:00100000:1.0:1789672938.088927:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 234 00000100:00100000:1.0:1789672938.088941:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:12484:x1876607714300288:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789672938.088995:0:6513:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789672938.089173:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:12484:x1876607714300288:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 234us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672938.089183:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 234 00000100:00100000:2.0:1789672938.107153:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672938.107364:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714300544 00000100:00100000:0.0:1789672938.107378:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714300544 00000100:00100000:0.0:1789672938.107474:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 235 00000100:00100000:0.0:1789672938.107487:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:12484:x1876607714300544:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789672938.107515:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672938.107525:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789672938.107575:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c9965f6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2533e expref: 67 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.107599:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:0.0:1789672938.107605:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672938.107622:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965fde lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25361 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789672938.108468:0:9524:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1789672938.108789:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965fe5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.108809:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.108823:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.108891:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c9965fde lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25361 expref: 69 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.108909:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25361 expref: 68 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.108916:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cfb478f1000) 00010000:00010000:0.0:1789672938.108919:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789672938.108922:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cd200, rc 0) 00000100:00100000:0.0:1789672938.109000:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+68:12484:x1876607714300544:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 1516us (1866us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789672938.109023:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 235 00000100:00100000:2.0:1789672938.116759:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672938.116897:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714300800 00000100:00100000:3.0:1789672938.116911:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714300800 00000100:00100000:3.0:1789672938.116983:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 236 00000100:00100000:3.0:1789672938.116995:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+68:12484:x1876607714300800:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789672938.117078:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672938.117116:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd200/0x6c78c4f8c9965fe5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25361 expref: 68 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117142:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cfb478f1000) 00010000:00010000:3.0:1789672938.117155:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789672938.117185:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965ff3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117203:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965ff3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117241:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965ff3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117258:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9965ffa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x473224f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117265:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9965ffa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x473224f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117271:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9965ffa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x473224f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117335:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965ff3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117343:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965ff3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117351:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965ff3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117357:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672938.117362:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965ff3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117371:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965ff3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117379:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:3.0:1789672938.117382:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672938.117399:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965ff3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117413:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9965ff3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117425:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9965ffa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x473224f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117431:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9965ffa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x473224f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117437:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9965ffa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x473224f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117442:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672938.117446:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9965ffa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x473224f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117452:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9965ffa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x473224f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117460:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x473224f3 (ffff8cfb419b1300) 00010000:00010000:3.0:1789672938.117463:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672938.117466:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9965ffa lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x473224f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.117472:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9965ffa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x473224f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672938.117600:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:12484:x1876607714300800:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 606us (857us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789672938.117608:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 236 00000100:00100000:1.0:1789672938.122541:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672938.122696:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714300928 00000100:00100000:3.0:1789672938.122709:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714300928 00000100:00100000:3.0:1789672938.122791:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 237 00000100:00100000:3.0:1789672938.122803:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+67:12484:x1876607714300928:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789672938.122833:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672938.122865:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966001 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25368 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.122928:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9966008 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.122946:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9966008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.122962:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9966008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.123119:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966001 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25368 expref: 69 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.123142:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9966008 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25368 expref: 68 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.123153:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cfb419b1300) 00010000:00010000:3.0:1789672938.123155:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789672938.123160:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e5400, rc 0) 00000100:00100000:3.0:1789672938.123249:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+68:12484:x1876607714300928:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 448us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672938.123256:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 237 00000100:00100000:2.0:1789672938.128486:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672938.132793:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714301184 00000100:00100000:0.0:1789672938.132821:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714301184 00000100:00100000:0.0:1789672938.135557:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 238 00000100:00100000:0.0:1789672938.135596:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+68:12484:x1876607714301184:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789672938.135746:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996600f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.135769:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996600f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.135784:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996600f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789672938.136028:0:9524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1789672938.136100:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004dd67422 reply state 0000000057c2de76 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996600f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.136115:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996600f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.136123:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cfb419b1300) 00010000:00010000:0.0:1789672938.136126:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789672938.136131:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789672938.136289:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+70:12484:x1876607714301184:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 711us (7814us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789672938.136298:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 238 00000100:00100000:2.0:1789672938.140074:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672938.140181:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714301312 00000100:00100000:1.0:1789672938.140194:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714301312 00000100:00100000:1.0:1789672938.140268:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 239 00000100:00100000:1.0:1789672938.140280:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+70:12484:x1876607714301312:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672938.140312:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672938.140340:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9966016 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2536f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.140435:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9966016 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2536f expref: 71 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.140479:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9966016 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2536f expref: 71 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.140504:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cfb419b1300) 00010000:00010000:1.0:1789672938.140508:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672938.140512:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435600, rc 0) 00000100:00100000:1.0:1789672938.140612:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+71:12484:x1876607714301312:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 332us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672938.140620:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 239 00000100:00100000:1.0:1789672938.143812:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672938.144779:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714301440 00000100:00100000:2.0:1789672938.144797:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714301440 00000100:00100000:2.0:1789672938.144917:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 70 00000100:00100000:2.0:1789672938.144931:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2395:x1876607714301440:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789672938.145256:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+10:2395:x1876607714301440:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 327us (1460us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1789672938.145266:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 70 00000100:00080000:1.0:1789672938.145474:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672938.147818:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672938.148135:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714301696 00000100:00100000:3.0:1789672938.148149:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714301696 00000100:00100000:3.0:1789672938.148222:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:3.0:1789672938.148235:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+71:12484:x1876607714301696:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789672938.148569:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+72:12484:x1876607714301696:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 336us (774us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789672938.148577:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:0.0:1789672938.154900:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672938.154991:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714301952 00000100:00100000:1.0:1789672938.155009:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714301952 00000100:00100000:1.0:1789672938.155096:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 240 00000100:00100000:1.0:1789672938.155110:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+72:12484:x1876607714301952:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789672938.155614:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+72:12484:x1876607714301952:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 504us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672938.155624:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 240 00000100:00100000:0.0:1789672938.162087:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672938.162202:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714302080 00000100:00100000:2.0:1789672938.162214:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714302080 00000100:00100000:2.0:1789672938.162327:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 241 00000100:00100000:2.0:1789672938.162348:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+72:12484:x1876607714302080:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672938.162377:0:9524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672938.162415:0:9524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996601d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25376 expref: -99 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.162507:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9966024 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.163808:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9966024 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.163843:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9966024 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672938.163928:0:9524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789672938.163987:0:9524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9966024 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.164037:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeec00/0x6c78c4f8c996601d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25376 expref: 74 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.164063:0:9524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9966024 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25376 expref: 73 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.164072:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cfb419b1300) 00010000:00010000:2.0:1789672938.164075:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789672938.164080:0:9524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef600, rc 0) 00000100:00100000:2.0:1789672938.164168:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+73:12484:x1876607714302080:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 1822us (2096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672938.164176:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 241 00000100:00100000:3.0:1789672938.169043:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672938.169272:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714302208 00000100:00100000:1.0:1789672938.169286:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714302208 00000100:00100000:1.0:1789672938.170594:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:1.0:1789672938.170622:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+10:2396:x1876607714302208:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789672938.170648:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789672938.170692:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c996602b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2537d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789672938.170751:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac3de8, blocks: 0x0 00010000:00010000:1.0:1789672938.170780:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1789672938.170786:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789672938.170798:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c996602b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2537d expref: 11 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.170823:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c996602b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2537d expref: 11 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.170839:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434600, rc 0) 00000100:00100000:1.0:1789672938.170933:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+11:2396:x1876607714302208:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 323us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672938.170942:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 71 00000100:00100000:0.0:1789672938.177955:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672938.178268:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714302464 00000100:00100000:3.0:1789672938.178285:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714302464 00000100:00100000:3.0:1789672938.178435:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 242 00000100:00100000:3.0:1789672938.178454:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+73:12484:x1876607714302464:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789672938.178643:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+73:12484:x1876607714302464:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 194us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672938.178655:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 242 00000100:00100000:0.0:1789672938.185530:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672938.185683:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714302592 00000100:00100000:2.0:1789672938.185697:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714302592 00000100:00100000:2.0:1789672938.185777:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:2.0:1789672938.185790:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+11:12484:x1876607714302592:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789672938.185816:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672938.185841:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9966032 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25384 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.185885:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c996602b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2537d expref: 12 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.185897:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672938.185902:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672938.185926:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9966032 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25384 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.185973:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c996602b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2537d expref: 12 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.185989:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c996602b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2537d expref: 12 pid: 8429 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672938.186007:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ab9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1876607738469632:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789672938.186131:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bbad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789672938.194859:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ab9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8430:1876607738469632:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672938.194921:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9966032 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25384 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672938.195044:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00010000:00010000:1.0:1789672938.195276:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aeec00, rc 0) 00000100:00100000:1.0:1789672938.195471:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+12:12484:x1876607714302592:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 9680us (9955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672938.195486:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 72 00000100:00100000:3.0:1789672938.199429:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714302720 00000100:00100000:3.0:1789672938.199454:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714302720 00010000:00010000:3.0:1789672938.199636:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c996602b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2537d expref: 12 pid: 8429 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672938.199720:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 103 00000100:00100000:3.0:1789672938.199735:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+12:2395:x1876607714302720:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672938.199763:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672938.199796:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c996602b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2537d expref: 12 pid: 8429 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.199841:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c996602b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2537d expref: 12 pid: 8429 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.199875:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091ba1884/0x6c78c4f8c996602b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2537d expref: 12 pid: 8429 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.199896:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672938.199902:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672938.199913:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9966032 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25384 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.199925:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9966032 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25384 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.199978:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9966032 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25384 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672938.199997:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f649500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1876607738469760:192.168.201.50@tcp:105: 00000100:00100000:3.0:1789672938.200139:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc411ca000 going to sleep for 11 seconds 00000100:00100000:2.0:1789672938.203874:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672938.204335:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714302848 00000100:00100000:0.0:1789672938.204348:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714302848 00002000:00100000:0.0:1789672938.204430:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8cfb47ab8380 x1876607714302848/t0(0) o4->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:564/0 lens 504/0 e 0 to 0 dl 1789672949 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789672938.204442:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfb47ab8380 with x1876607714302848 ext(0->12) 00002000:00010000:0.0:1789672938.204451:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfb47ab8380 00000100:00100000:1.0:1789672938.204466:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f649500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1876607738469760:192.168.201.50@tcp:105: 00000100:00100000:0.0:1789672938.204483:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:0.0:1789672938.204493:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+12:2396:x1876607714302848:12345-192.168.201.50@tcp:4:lhsmtool_posix.0 00010000:00010000:1.0:1789672938.204496:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672938.204937:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+12:2395:x1876607714302720:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 5204us (9892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672938.204949:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 103 00000100:00100000:0.0:1789672938.207935:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+13:2396:x1876607714302848:12345-192.168.201.50@tcp:4:lhsmtool_posix.0 Request processed in 3424us (4070us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789672938.207956:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 6 00002000:00100000:0.0:1789672938.207978:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8cfb47ab8380 x1876607714302848/t4294967321(0) o4->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:564/0 lens 504/448 e 0 to 0 dl 1789672949 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789672938.207992:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfb47ab8380 with x1876607714302848 ext(0->12) 00002000:00010000:0.0:1789672938.208003:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfb47ab8380 00000100:00100000:3.0:1789672938.223524:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672938.223760:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714302976 00000100:00100000:1.0:1789672938.223775:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714302976 00000100:00100000:1.0:1789672938.223854:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 243 00000100:00100000:1.0:1789672938.223868:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+73:12484:x1876607714302976:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789672938.228446:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1789672938.228502:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1789672938.228545:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfc49918300 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789672938.228553:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc4545c400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfc49918d80 00000020:00080000:0.0:1789672938.228556:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc4545c300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cfb47a7f000 00000004:00080000:0.0:1789672938.228635:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1789672938.228728:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfc6155af00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789672938.228734:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc49c67900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfc4a57c6c0 00000020:00080000:2.0:1789672938.228742:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789672938.228766:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc49c67d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cfc6a1e1600 00000020:00080000:0.0:1789672938.228802:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1789672938.228817:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1789672938.228901:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:3.0:1789672938.229205:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965d37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229229:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965d37 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229238:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965d37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229247:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672938.229254:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965d37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229265:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965d37 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672938.229273:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738469888:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789672938.229291:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8cfc61501800) 00010000:00010000:3.0:1789672938.229297:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672938.229303:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965d37 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229309:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9965d37 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229365:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965ddf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229372:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965ddf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229377:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965ddf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229390:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672938.229400:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965ddf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229406:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965ddf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229415:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8cfc45324000) 00010000:00010000:3.0:1789672938.229417:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672938.229420:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965ddf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229426:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c9965ddf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229443:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229450:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e5d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229456:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229460:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cce00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672938.229463:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229470:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e5d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229477:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb478f1c00) 00010000:00010000:3.0:1789672938.229479:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672938.229491:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e5d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229497:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cce00/0x6c78c4f8c9965e5d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229511:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229518:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e80 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229523:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229528:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aee200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672938.229531:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229537:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e80 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229544:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb478f1c00) 00010000:00010000:3.0:1789672938.229547:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672938.229549:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e80 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229555:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee200/0x6c78c4f8c9965e80 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229571:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965f52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229587:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965f52 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229594:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965f52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229599:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672938.229602:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965f52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672938.229614:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672938.229625:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965f52 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229635:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:3.0:1789672938.229637:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672938.229641:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965f52 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229645:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9965f52 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229714:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996600f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229722:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996600f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229728:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996600f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229734:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cda00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672938.229743:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996600f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229751:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996600f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229763:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cfb419b1300) 00010000:00010000:3.0:1789672938.229767:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789672938.229771:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996600f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.229777:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cda00/0x6c78c4f8c996600f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672938.229969:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672938.229990:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738470016:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789672938.230100:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:12484:x1876607714302976:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 Request processed in 6229us (6584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672938.230115:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 243 00000100:00100000:0.0:1789672938.231429:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738469888 00000100:00100000:0.0:1789672938.231450:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738469888 00000100:00100000:0.0:1789672938.231571:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789672938.231586:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1876607738469888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789672938.231633:0:8494:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:0.0:1789672938.231704:0:8494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c9966039 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.231734:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038e10c5d/0x6c78c4f8c9965ded lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252dc expref: 12 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.231746:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789672938.231753:0:8494:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789672938.231758:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c9966039 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.231807:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038e10c5d/0x6c78c4f8c9965ded lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252dc expref: 12 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.231827:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038e10c5d/0x6c78c4f8c9965ded lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252dc expref: 12 pid: 8428 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672938.231847:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d938e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8494:1876607738470144:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672938.234588:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672938.234692:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738470016 00000100:00100000:2.0:1789672938.234706:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738470016 00000100:00100000:2.0:1789672938.234784:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789672938.234795:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876607738470016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789672938.234838:0:8428:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:2.0:1789672938.234884:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aac3de7, atime: 0x6aac3de7, ctime: 0x6aac3de7, blocks: 0x8 00010000:00010000:2.0:1789672938.234893:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9fe0b5a/0x6c78c4f8c9966040 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.234936:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=416s v=(0 0) 00010000:00010000:2.0:1789672938.234941:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789672938.234950:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9fe0b5a/0x6c78c4f8c9966040 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.234970:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9fe0b5a/0x6c78c4f8c9966040 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.234982:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9fe0b5a/0x6c78c4f8c9966040 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.234992:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9fe0b5a/0x6c78c4f8c9966040 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.235026:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789672938.235339:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3638:x1876607738470016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 545us (761us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789672938.235348:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1789672938.235411:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672938.235420:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9fe0b5a/0x6c78c4f8c9966040 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.235430:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aee800 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789672938.235435:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9fe0b5a/0x6c78c4f8c9966040 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.235446:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9fe0b5a/0x6c78c4f8c9966040 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.235467:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9fe0b5a/0x6c78c4f8c9966040 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.235485:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9fe0b5a/0x6c78c4f8c9966040 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.235510:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672938.235512:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672938.235514:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789672938.235563:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfc7c404000/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789672938.235573:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738470016:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789672938.237746:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00080000:2.0:1789672938.238013:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672938.238201:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714303104 00000100:00100000:3.0:1789672938.238214:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714303104 00000100:00100000:3.0:1789672938.238286:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 75 00000100:00100000:3.0:1789672938.238299:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+13:2395:x1876607714303104:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789672938.238781:0:8494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c604900 going to sleep for 11 seconds 00000100:00100000:0.0:1789672938.241071:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d938e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8494:1876607738470144:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789672938.241113:0:8494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c9966039 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789672938.241412:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1789672938.241440:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:2.0:1789672938.241616:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2395:x1876607714303104:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 Request processed in 3316us (3880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672938.241630:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 75 00000100:00100000:2.0:1789672938.247972:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672938.248026:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672938.248040:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714303232 00000100:00100000:3.0:1789672938.248053:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714303232 00010000:00010000:3.0:1789672938.248127:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038e10c5d/0x6c78c4f8c9965ded lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252dc expref: 8 pid: 8428 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672938.248176:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 104 00000100:00100000:3.0:1789672938.248188:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47abad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2396:x1876607714303232:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672938.248208:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672938.248214:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038e10c5d/0x6c78c4f8c9965ded lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252dc expref: 8 pid: 8428 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.248253:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038e10c5d/0x6c78c4f8c9965ded lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252dc expref: 8 pid: 8428 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.248285:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038e10c5d/0x6c78c4f8c9965ded lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252dc expref: 8 pid: 8428 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.248310:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672938.248319:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672938.248326:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c9966039 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.248336:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c9966039 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.248405:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672938.248491:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47abad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714303232:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 304us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672938.248502:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 104 00010000:00010000:1.0:1789672938.248513:0:8494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c9966039 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.248547:0:8494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c9966039 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.248560:0:8494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c9966039 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.248568:0:8494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c9966039 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.248597:0:8494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789672938.248861:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672938.248872:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c9966039 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.248884:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd600 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789672938.248891:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c9966039 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.248927:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c9966039 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.248952:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c9966039 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.248962:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008af85942/0x6c78c4f8c9966039 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.248996:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672938.249000:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672938.249005:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672938.249272:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3636:x1876607738469888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17685us (19662us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789672938.249283:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789672938.249485:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714303488 00000100:00100000:0.0:1789672938.249500:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714303488 00000100:00100000:0.0:1789672938.249578:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 244 00000100:00100000:0.0:1789672938.249595:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:12484:x1876607714303488:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789672938.249725:0:9524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672938.249757:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef600/0x6c78c4f8c9966024 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25376 expref: 21 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.249783:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cfb419b1300) 00010000:00010000:0.0:1789672938.249791:0:9524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789672938.249836:0:9524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9966047 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.249855:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9966047 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.249868:0:9524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9966047 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672938.250076:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:2.0:1789672938.250087:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000004:00010000:1.0:1789672938.250303:0:9524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003aef7e31 reply state 00000000d9d42fc8 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9966047 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672938.250315:0:3636:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cfc7f678a80 x1876607738469888/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789672954 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789672938.250343:0:9524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9966047 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.250351:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cfb419b1300) 00010000:00010000:1.0:1789672938.250354:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789672938.250357:0:9524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00080000:2.0:1789672938.250436:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfc7f678a80/2, rc 0, transno 4294967322 00000100:00100000:2.0:1789672938.250461:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738469888:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789672938.250494:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:12484:x1876607714303488:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 902us (2463us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1789672938.250507:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 244 00000100:00100000:2.0:1789672938.253919:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672938.254557:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714303616 00000100:00100000:3.0:1789672938.254579:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714303616 00000100:00100000:3.0:1789672938.254697:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 76 00000100:00100000:3.0:1789672938.254711:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47aba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2396:x1876607714303616:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789672938.254932:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789672938.254936:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789672936 00002000:00010000:3.0:1789672938.254939:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789672935 00002000:00010000:3.0:1789672938.254942:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789672936 -> 1789672936 00002000:00010000:3.0:1789672938.254944:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789672938.255033:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47aba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2396:x1876607714303616:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 325us (1124us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789672938.255042:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 76 00000100:00100000:0.0:1789672938.259408:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672938.260208:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714303872 00000100:00100000:3.0:1789672938.260241:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714303872 00000100:00100000:3.0:1789672938.260315:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 245 00000100:00100000:3.0:1789672938.260329:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:12484:x1876607714303872:12345-192.168.201.50@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789672938.260443:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c996604e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.260466:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9966008 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25368 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.260480:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c996604e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.260536:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9966008 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25368 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.260557:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9966008 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25368 expref: 22 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672938.260576:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738470272:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672938.260915:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc411cae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789672938.263303:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672938.263400:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714304000 00000100:00100000:0.0:1789672938.263417:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714304000 00010000:00010000:0.0:1789672938.263481:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9966008 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25368 expref: 23 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672938.263703:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 105 00000100:00100000:0.0:1789672938.263715:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+23:2396:x1876607714304000:12345-192.168.201.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789672938.263729:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738470272:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789672938.263734:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672938.263742:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9966008 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25368 expref: 23 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.263757:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9966008 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25368 expref: 23 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.263769:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c996604e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.263787:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c9966008 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25368 expref: 23 pid: 6514 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.273891:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cfb419b1300) 00010000:00010000:0.0:1789672938.273912:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c996604e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.273933:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c996604e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.273943:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c996604e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.278068:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672938.278179:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:2396:x1876607714304000:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 14454us (14874us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672938.278196:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 105 00010000:00010000:3.0:1789672938.278301:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c996604e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.278314:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c996604e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.278407:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c996604e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.278416:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c996604e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.278423:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c996604e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.278429:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672938.278435:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c996604e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.278443:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c996604e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.278465:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cfb419b1300) 00010000:00010000:3.0:1789672938.278469:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789672938.278475:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c996604e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.278481:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c996604e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672938.278539:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:12484:x1876607714303872:12345-192.168.201.50@tcp:55:lhsmtool_posix.0 Request processed in 18213us (19160us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789672938.278547:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 245 00000100:00100000:2.0:1789672938.287903:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672938.288036:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714304128 00000100:00100000:3.0:1789672938.288048:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714304128 00000100:00100000:3.0:1789672938.288130:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 77 00000100:00100000:3.0:1789672938.288163:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2397:x1876607714304128:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789672938.288224:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966055 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.288250:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9966032 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25384 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.288260:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789672938.288265:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789672938.288272:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966055 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.288315:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9966032 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25384 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.288333:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9966032 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25384 expref: 8 pid: 8430 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672938.288352:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876607738470400:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672938.288482:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc411cae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789672938.294921:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8429:1876607738470400:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789672938.294965:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966055 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672938.295977:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672938.299471:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714304256 00000100:00100000:1.0:1789672938.299493:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714304256 00010000:00010000:1.0:1789672938.299642:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9966032 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25384 expref: 9 pid: 8430 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672938.299745:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 106 00000100:00100000:1.0:1789672938.299758:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+9:2396:x1876607714304256:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672938.299779:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672938.299807:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9966032 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25384 expref: 9 pid: 8430 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.299823:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9966032 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25384 expref: 9 pid: 8430 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.299878:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb9fd8c2/0x6c78c4f8c9966032 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25384 expref: 9 pid: 8430 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.299900:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789672938.299907:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789672938.299914:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966055 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.299926:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966055 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.302552:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672938.302683:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2396:x1876607714304256:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 2903us (6689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672938.302699:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 106 00010000:00010000:2.0:1789672938.303514:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966055 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.303590:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966055 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.303632:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966055 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.303642:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966055 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.303653:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966055 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.304774:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4c00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789672938.304782:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966055 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.304826:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966055 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.304855:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966055 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.304865:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966055 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672938.305809:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2397:x1876607714304128:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 Request processed in 16824us (17097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672938.305828:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 77 00000100:00100000:2.0:1789672938.310974:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672938.311118:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714304512 00000100:00100000:1.0:1789672938.311132:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714304512 00000100:00100000:1.0:1789672938.311215:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 246 00000100:00100000:1.0:1789672938.311226:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:12484:x1876607714304512:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789672938.311329:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996605c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.311359:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965f4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25330 expref: 21 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.311370:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996605c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.311436:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965f4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25330 expref: 21 pid: 9524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.311450:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965f4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25330 expref: 21 pid: 9524 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672938.311465:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738470528:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789672938.311571:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789672938.314172:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738470528:192.168.201.50@tcp:104: 00010000:00010000:1.0:1789672938.314206:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996605c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672938.314912:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672938.315009:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714304640 00000100:00100000:1.0:1789672938.315019:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714304640 00010000:00010000:1.0:1789672938.315062:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965f4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25330 expref: 22 pid: 9524 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672938.315156:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 107 00000100:00100000:1.0:1789672938.315167:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:2396:x1876607714304640:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672938.315186:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672938.315195:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965f4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25330 expref: 22 pid: 9524 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.315208:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965f4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25330 expref: 22 pid: 9524 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.315252:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef800/0x6c78c4f8c9965f4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25330 expref: 22 pid: 9524 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.315270:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672938.315276:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c9965fad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25353 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.315287:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996605c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.315295:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996605c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.315303:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996605c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.315340:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789672938.315379:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996605c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.315403:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996605c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672938.315422:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:2396:x1876607714304640:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 255us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672938.315432:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 107 00010000:00010000:3.0:1789672938.320117:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966063 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.320174:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9966016 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2536f expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.320186:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966063 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.320439:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9966016 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2536f expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.320457:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9966016 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2536f expref: 21 pid: 6513 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672938.320477:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738470656:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672938.320649:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc411cae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789672938.330546:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672938.330705:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714304768 00000100:00100000:0.0:1789672938.330717:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714304768 00010000:00010000:0.0:1789672938.330774:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9966016 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2536f expref: 22 pid: 6513 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789672938.330842:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 108 00000100:00100000:0.0:1789672938.330853:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f869450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:2395:x1876607714304768:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672938.330872:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672938.330881:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9966016 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2536f expref: 22 pid: 6513 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.330895:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9966016 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2536f expref: 22 pid: 6513 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.330924:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cfb419b1300) 00010000:00010000:0.0:1789672938.330932:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966063 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.330943:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966063 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.330952:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966063 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672938.330977:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672938.331054:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f869450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:2395:x1876607714304768:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 202us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672938.331062:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 108 00010000:00010000:3.0:1789672938.331699:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435600/0x6c78c4f8c9966016 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2536f expref: 21 pid: 6513 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672938.331721:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738470656:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789672938.331749:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966063 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.331759:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966063 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.331765:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966063 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789672938.331924:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1789672938.332074:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1789672938.332115:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1789672938.332231:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1876607738470784:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789672938.332300:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672938.332330:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7f606840 going to sleep for 11 seconds 00000100:00100000:0.0:1789672938.332513:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738470784 00000100:00100000:0.0:1789672938.332532:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738470784 00000100:00100000:0.0:1789672938.332590:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789672938.332600:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6512:x1876607738470784:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789672938.332754:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6512:x1876607738470784:12345-0@lo:1000:mdt00_000.0 Request processed in 155us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672938.332763:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789672938.332929:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1876607738470784:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789672938.333083:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1789672938.333141:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1876607738470912:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789672938.333178:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672938.333207:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789672938.333274:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738470912 00000100:00100000:2.0:1789672938.333281:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738470912 00000100:00100000:2.0:1789672938.333325:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789672938.333333:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6512:x1876607738470912:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789672938.333477:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6512:x1876607738470912:12345-0@lo:1000:mdt00_000.0 Request processed in 144us (298us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789672938.333493:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789672938.333646:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6512:1876607738470912:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789672938.333733:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966063 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.333746:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966063 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.333756:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966063 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.333763:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672938.333769:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966063 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.333780:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966063 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.333801:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cfb419b1300) 00010000:00010000:1.0:1789672938.333805:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672938.333812:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966063 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.333819:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4a00/0x6c78c4f8c9966063 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.333852:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965fa6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.333860:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965fa6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.333866:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965fa6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.333883:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672938.333887:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965fa6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.333894:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965fa6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.333903:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672938.333906:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672938.333914:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c9965fad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25353 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.333928:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c9965fad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25353 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.333940:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c9965fad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25353 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.333973:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c9965fad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25353 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672938.333987:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c406a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738471040:192.168.201.50@tcp:105: 00000100:00100000:1.0:1789672938.334068:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb4687f000 going to sleep for 11 seconds 00000100:00100000:2.0:1789672938.336981:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672938.337068:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714304896 00000100:00100000:3.0:1789672938.337080:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714304896 00000100:00100000:3.0:1789672938.337162:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:3.0:1789672938.337174:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:12482:x1876607714304896:12345-192.168.201.50@tcp:49:lfs.0 00000100:00100000:3.0:1789672938.337351:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+25:12482:x1876607714304896:12345-192.168.201.50@tcp:49:lfs.0 Request processed in 179us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672938.337359:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:1.0:1789672938.337706:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c406a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6512:1876607738471040:192.168.201.50@tcp:105: 00010000:00010000:1.0:1789672938.337748:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965fa6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337784:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9965fa6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337828:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c996606a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337847:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c996606a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337863:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c996606a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337875:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c996606a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337882:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c996606a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337889:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c996606a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337895:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672938.337899:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c996606a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337907:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c996606a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337920:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672938.337924:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672938.337928:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c996606a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337944:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435400/0x6c78c4f8c996606a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337956:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996605c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337963:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996605c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337968:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996605c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337974:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672938.337977:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996605c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337983:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996605c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.337992:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672938.337994:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789672938.337997:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996605c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.338002:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996605c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672938.338322:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+24:12484:x1876607714304512:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 27096us (27363us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789672938.338335:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 246 00000020:00080000:1.0:1789672938.338345:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789672938.343037:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672938.343092:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672938.343199:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714305408 00000100:00100000:0.0:1789672938.343212:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714305408 00000100:00100000:0.0:1789672938.343291:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 247 00000100:00100000:0.0:1789672938.343304:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+24:12482:x1876607714305408:12345-192.168.201.50@tcp:58:lfs.0 00000040:00080000:0.0:1789672938.343560:0:9524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789672938.343714:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+24:12482:x1876607714305408:12345-192.168.201.50@tcp:58:lfs.0 Request processed in 412us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672938.343725:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 247 00000100:00100000:3.0:1789672938.343964:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714305152 00000100:00100000:3.0:1789672938.343971:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714305152 00000100:00100000:3.0:1789672938.344006:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:3.0:1789672938.344015:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f851450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+24:12484:x1876607714305152:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789672938.344259:0:6515:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789672938.344300:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1789672938.344340:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9966071 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.344359:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9966071 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.344373:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9966071 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.344396:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9966071 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.344425:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9966071 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.344433:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9966071 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.344454:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789672938.344498:0:13186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672938.344505:0:13186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9966071 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.344513:0:13186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4c00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789672938.344517:0:13186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9966071 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.344527:0:13186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9966071 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.344541:0:13186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cfb419b1300) 00010000:00010000:3.0:1789672938.344545:0:13186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789672938.344551:0:13186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9966071 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.344557:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9966071 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.344573:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672938.344575:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672938.344577:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672938.344631:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f851450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+26:12484:x1876607714305152:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 617us (1609us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789672938.344648:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 62 00000020:00080000:3.0:1789672938.344652:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1789672938.344892:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789672938.344898:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789672938.344931:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789672938.344943:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789672938.345054:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1876607738471168:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789672938.345102:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bbab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789672938.349161:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1876607738471168:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789672938.355085:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672938.356860:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714305536 00000100:00100000:3.0:1789672938.356882:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714305536 00000100:00100000:3.0:1789672938.357046:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 248 00000100:00100000:3.0:1789672938.357060:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+26:12485:x1876607714305536:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789672938.357115:0:6514:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789672938.357288:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+26:12485:x1876607714305536:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 231us (2217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672938.357296:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 248 00000100:00100000:1.0:1789672938.383989:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672938.386128:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714305792 00000100:00100000:3.0:1789672938.386151:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714305792 00000100:00100000:3.0:1789672938.386242:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 249 00000100:00100000:3.0:1789672938.386255:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+26:12485:x1876607714305792:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789672938.386520:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672938.386551:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9966078 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2538b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.391429:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c996607f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.391468:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c996607f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.391487:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c996607f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672938.391512:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789672938.391714:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c9966078 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2538b expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.391742:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c996607f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2538b expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.391752:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:2.0:1789672938.391755:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789672938.391778:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee800, rc 0) 00000100:00100000:2.0:1789672938.391874:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+28:12485:x1876607714305792:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 5620us (7901us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789672938.391884:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 249 00000100:00100000:0.0:1789672938.399237:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672938.399407:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714306048 00000100:00100000:1.0:1789672938.399420:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714306048 00000100:00100000:1.0:1789672938.399499:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 250 00000100:00100000:1.0:1789672938.399511:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+28:12485:x1876607714306048:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789672938.399798:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996608d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.399822:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996608d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.399837:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996608d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.400079:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996608d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.400088:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996608d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.400096:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996608d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.400102:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434a00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789672938.400107:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996608d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.400117:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996608d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.400150:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672938.400153:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789672938.400160:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996608d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.400167:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434a00/0x6c78c4f8c996608d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672938.400708:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+29:12485:x1876607714306048:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 1195us (1481us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789672938.400719:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 250 00000040:00080000:3.0:1789672938.406257:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672938.406271:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789672938.408244:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789672938.408277:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789672938.409939:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672938.409994:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672938.410094:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714306176 00000100:00100000:3.0:1789672938.410108:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714306176 00000100:00100000:3.0:1789672938.410180:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 251 00000100:00100000:3.0:1789672938.410192:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+29:12487:x1876607714306176:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789672938.410243:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789672938.410276:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9966094 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25392 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.410367:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c996609b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.410398:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c996609b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.410415:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c996609b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.410437:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c99660a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.410446:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c99660a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.410454:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c99660a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.410564:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c99660a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.410576:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2534c expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.410587:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c99660a9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.410632:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2534c expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672938.410655:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2534c expref: 30 pid: 6512 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789672938.410698:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738471296:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789672938.410811:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7f606900 going to sleep for 11 seconds 00000100:00100000:1.0:1789672938.415207:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714306432 00000100:00100000:1.0:1789672938.415230:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714306432 00000100:00100000:1.0:1789672938.415310:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:1.0:1789672938.415323:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+31:12485:x1876607714306432:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789672938.417411:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6514:1876607738471296:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789672938.417459:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c99660a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672938.424669:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+32:12485:x1876607714306432:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 9317us (14642us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789672938.424690:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:0.0:1789672938.425713:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672938.427584:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714306688 00000100:00100000:1.0:1789672938.427603:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714306688 00000100:00100000:1.0:1789672938.427734:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:1.0:1789672938.427746:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+32:6168:x1876607714306688:12345-192.168.201.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789672938.428046:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+33:6168:x1876607714306688:12345-192.168.201.50@tcp:35:ldlm_bl.0 Request processed in 300us (2340us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789672938.428055:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:2.0:1789672938.438465:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672938.438563:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714306816 00000100:00100000:1.0:1789672938.438598:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714306816 00010000:00010000:1.0:1789672938.438653:0:7920:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2534c expref: 33 pid: 6512 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789672938.438735:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 109 00000100:00100000:1.0:1789672938.438746:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+33:2396:x1876607714306816:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672938.438766:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672938.438773:0:7920:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2534c expref: 33 pid: 6512 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.438789:0:7920:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2534c expref: 33 pid: 6512 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.438815:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434200/0x6c78c4f8c9965f98 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2534c expref: 33 pid: 6512 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.438836:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672938.438842:0:7920:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c99660a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.438854:0:7920:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c99660a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.438864:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c99660a9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672938.438902:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672938.438970:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+32:2396:x1876607714306816:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 226us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672938.438987:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 109 00010000:00010000:2.0:1789672938.439363:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c99660a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439373:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c99660a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672938.439452:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789672938.439459:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789672938.439484:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c99660a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439499:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c99660a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439511:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c996609b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439518:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c996609b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439526:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c996609b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439547:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672938.439552:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c996609b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439560:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c996609b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439571:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:2.0:1789672938.439574:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672938.439578:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c996609b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439584:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5800/0x6c78c4f8c996609b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439598:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c99660a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439605:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c99660a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439610:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c99660a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439615:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672938.439618:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c99660a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439624:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c99660a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439648:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8cfb419b1d00) 00010000:00010000:2.0:1789672938.439651:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789672938.439654:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c99660a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439703:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4000/0x6c78c4f8c99660a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439752:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4e00/0x6c78c4f8c9966094 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25392 expref: 32 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439770:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c99660a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25392 expref: 31 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672938.439777:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:2.0:1789672938.439779:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789672938.439782:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e5a00, rc 0) 00000100:00100000:2.0:1789672938.439828:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+31:12487:x1876607714306176:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 29638us (29902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672938.439836:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 251 00010000:00010000:3.0:1789672938.695010:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672938.821262:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738471424:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.821388:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672938.821467:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738471936:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.821498:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672938.821533:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738472448:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.821580:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672938.821631:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789672938.821644:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738471808:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.821727:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672938.821822:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738472320:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.821884:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672938.821946:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738471552:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.821988:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672938.822013:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738472064:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.822043:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672938.822064:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738472576:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.822084:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672938.822106:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789672938.822113:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738471680:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.822138:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672938.822157:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738472192:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.822176:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672938.822186:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738472704:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.822206:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672938.822246:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738471424 00000100:00100000:0.0:1789672938.822257:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738471424 00000100:00100000:0.0:1789672938.822321:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1789672938.822332:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738471424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.822409:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738471424:12345-0@lo:400:kworker.0 Request processed in 79us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672938.822417:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1789672938.822459:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738471936 00000100:00100000:0.0:1789672938.822463:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738471936 00000100:00100000:0.0:1789672938.822496:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738471680 00000100:00100000:0.0:1789672938.822499:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738471680 00000100:00100000:0.0:1789672938.822531:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789672938.822539:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738471936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.822580:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738471936:12345-0@lo:400:kworker.0 Request processed in 43us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672938.822586:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789672938.822599:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789672938.822604:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738471680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.822640:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738471680:12345-0@lo:400:kworker.0 Request processed in 36us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672938.822646:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789672938.822691:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738472448 00000100:00100000:0.0:1789672938.822695:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738472448 00000100:00100000:0.0:1789672938.822739:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738471808 00000100:00100000:0.0:1789672938.822743:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738471808 00000100:00100000:0.0:1789672938.822761:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738471552 00000100:00100000:0.0:1789672938.822765:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738471552 00000100:00100000:0.0:1789672938.822785:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738472064 00000100:00100000:0.0:1789672938.822788:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738472064 00000100:00100000:0.0:1789672938.822807:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738472576 00000100:00100000:0.0:1789672938.822810:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738472576 00000100:00100000:0.0:1789672938.822824:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738472192 00000100:00100000:0.0:1789672938.822826:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738472192 00000100:00100000:0.0:1789672938.822846:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789672938.822854:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738472448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.822894:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738472448:12345-0@lo:400:kworker.0 Request processed in 41us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672938.822901:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789672938.822913:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789672938.822919:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738471808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.822961:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738471808:12345-0@lo:400:kworker.0 Request processed in 43us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672938.822969:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789672938.822984:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789672938.822993:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738471552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.823027:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738471552:12345-0@lo:400:kworker.0 Request processed in 36us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672938.823033:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789672938.823047:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789672938.823053:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738472064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.823085:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738472064:12345-0@lo:400:kworker.0 Request processed in 33us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672938.823092:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789672938.823106:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789672938.823112:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738472576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.823144:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738472576:12345-0@lo:400:kworker.0 Request processed in 32us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672938.823149:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789672938.823161:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789672938.823169:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738472192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.823201:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738472192:12345-0@lo:400:kworker.0 Request processed in 33us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672938.823207:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789672938.823229:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738472320 00000100:00100000:0.0:1789672938.823234:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738472320 00000100:00100000:0.0:1789672938.823273:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738472704 00000100:00100000:0.0:1789672938.823276:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738472704 00000100:00100000:0.0:1789672938.823303:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789672938.823311:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738472320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.823350:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738472320:12345-0@lo:400:kworker.0 Request processed in 40us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672938.823360:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789672938.823394:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789672938.823405:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738472704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.823452:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738472704:12345-0@lo:400:kworker.0 Request processed in 49us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672938.823459:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1789672938.823498:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672938.823503:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789672938.823506:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789672938.823509:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672938.823559:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738471680:0@lo:400:kworker.0 00010000:00080000:0.0:1789672938.823581:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f679880 x1876607738472192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672938.823596:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738472192:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.823612:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738472704:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.823626:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738471552:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.823642:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738472064:0@lo:400:kworker.0 00010000:00080000:0.0:1789672938.823689:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47abb800 x1876607738472576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672938.823724:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738472576:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.823801:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738471808:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.823820:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738472320:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.823833:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738471424:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.823850:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738471936:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.823866:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738472448:0@lo:400:kworker.0 00000100:00100000:0.0:1789672938.834608:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738472832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789672938.834748:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672938.834869:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672938.834882:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738472960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789672938.834920:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672938.835053:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738472832 00000100:00100000:0.0:1789672938.835064:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738472832 00000100:00100000:0.0:1789672938.835126:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738472960 00000100:00100000:0.0:1789672938.835129:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738472960 00000100:00100000:0.0:1789672938.835148:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789672938.835157:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1876607738472832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789672938.835191:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3691978752 00000100:00100000:3.0:1789672938.835209:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789672938.835220:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738472960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789672938.835231:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3691978752 00000100:00100000:0.0:1789672938.835253:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1876607738472832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672938.835262:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789672938.835268:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738472960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672938.835286:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789672938.835334:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738472960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789672938.835365:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738472832:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1789672939.511118:0:14756:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789672939.511127:0:14756:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789672939.511156:0:14756:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789672939.511162:0:14756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789672939.718684:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672939.719785:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714307072 00000100:00100000:2.0:1789672939.719797:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714307072 00000100:00100000:2.0:1789672939.719854:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 252 00000100:00100000:2.0:1789672939.719864:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+31:12510:x1876607714307072:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789672939.719887:0:11081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789672939.719906:0:11081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c99660b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25399 expref: -99 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672939.720029:0:11081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99660b7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672939.720043:0:11081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99660b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672939.720054:0:11081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99660b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789672939.720064:0:11081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789672939.720171:0:11081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aefe00/0x6c78c4f8c99660b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25399 expref: 34 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672939.720188:0:11081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99660b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25399 expref: 33 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672939.720197:0:11081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:2.0:1789672939.720200:0:11081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789672939.720203:0:11081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef400, rc 0) 00000100:00100000:2.0:1789672939.720260:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+33:12510:x1876607714307072:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 398us (1607us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789672939.720266:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 252 00010000:00010000:3.0:1789672939.727586:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672939.727993:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672939.728071:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714307200 00000100:00100000:2.0:1789672939.728081:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714307200 00000100:00100000:2.0:1789672939.728290:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 253 00000100:00100000:2.0:1789672939.728304:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+33:12510:x1876607714307200:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:2.0:1789672939.728464:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99660c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672939.728490:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99660c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672939.728556:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99660c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672939.728593:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99660c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672939.728600:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99660c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672939.728606:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99660c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672939.728612:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aee600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789672939.728616:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99660c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672939.728623:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99660c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672939.728634:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:2.0:1789672939.728637:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789672939.728642:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99660c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672939.728648:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee600/0x6c78c4f8c99660c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789672939.728872:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+33:12510:x1876607714307200:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 571us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672939.728888:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 253 00000100:00100000:2.0:1789672939.835787:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672939.835895:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714307328 00000100:00100000:0.0:1789672939.835906:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714307328 00000100:00100000:0.0:1789672939.835978:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 78 00000100:00100000:0.0:1789672939.835990:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2398:x1876607714307328:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:0.0:1789672939.836010:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789672939.836033:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033840ce9/0x6c78c4f8c99660cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd253a0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789672939.836062:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aac3de8, atime: 0x6aac3de7, ctime: 0x6aac3de8, blocks: 0x8 00010000:00010000:0.0:1789672939.836084:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=417s v=(0 0) 00010000:00010000:0.0:1789672939.836089:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789672939.836098:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033840ce9/0x6c78c4f8c99660cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253a0 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672939.836116:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033840ce9/0x6c78c4f8c99660cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253a0 expref: 8 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672939.836130:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cd200, rc 0) 00000100:00100000:0.0:1789672939.836603:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2398:x1876607714307328:12345-192.168.201.50@tcp:101:cat.0 Request processed in 613us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672939.836610:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 78 00000100:00100000:2.0:1789672939.850380:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672939.850487:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714307456 00000100:00100000:3.0:1789672939.850505:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714307456 00002000:00100000:3.0:1789672939.850562:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8cfc462de680 x1876607714307456/t0(0) o3->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:565/0 lens 488/0 e 0 to 0 dl 1789672950 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789672939.850574:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfc462de680 with x1876607714307456 ext(0->4095) 00002000:00010000:3.0:1789672939.850580:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfc462de680 00000100:00100000:3.0:1789672939.850615:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:3.0:1789672939.850636:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2397:x1876607714307456:12345-192.168.201.50@tcp:3:cat.0 00000100:00100000:3.0:1789672939.850831:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2397:x1876607714307456:12345-192.168.201.50@tcp:3:cat.0 Request processed in 196us (461us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789672939.850839:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00002000:00100000:3.0:1789672939.850859:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8cfc462de680 x1876607714307456/t0(0) o3->ad795a16-0aa4-4e04-82a0-6f12aab5f2ea@192.168.201.50@tcp:565/0 lens 488/4536 e 0 to 0 dl 1789672950 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789672939.850868:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cfc462de680 with x1876607714307456 ext(0->4095) 00002000:00010000:3.0:1789672939.850871:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cfc462de680 00000004:00080000:3.0:1789672940.357162:0:8493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 418272500516ns, next at 419272497385ns, rc = 0 00000100:00100000:0.0:1789672940.357427:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738473216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672940.357517:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672940.357597:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672940.357604:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738473088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789672940.357626:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672940.366576:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738473216 00000100:00100000:1.0:1789672940.366593:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738473216 00000100:00080000:0.0:1789672940.366692:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672940.366871:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738473088 00000100:00100000:1.0:1789672940.366876:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738473088 00000100:00100000:1.0:1789672940.366911:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1789672940.366917:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672940.366924:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1876607738473216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672940.366958:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789672940.367051:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1876607738473216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (9533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672940.367059:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789672940.367076:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789672940.367082:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738473088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789672940.367092:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789672940.367118:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738473088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (9490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672940.367124:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789672940.367726:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738473088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789672940.367746:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738473216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789672940.739895:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672941.380219:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789672941.380244:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738473344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672941.380339:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672941.380412:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738473344 00000100:00100000:1.0:1789672941.380419:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738473344 00000100:00100000:1.0:1789672941.380486:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789672941.380494:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738473344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789672941.380526:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789672941.380570:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738473344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672941.380577:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789672941.380622:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738473344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672941.519542:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672941.519583:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672941.519620:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672941.519645:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672941.519692:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672941.519711:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672941.519732:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672941.519763:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714308096 00000100:00100000:1.0:1789672941.519773:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714308096 00000100:00100000:1.0:1789672941.519833:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714307968 00000100:00100000:1.0:1789672941.519837:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714307968 00000100:00100000:1.0:1789672941.519864:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 128 00000100:00100000:1.0:1789672941.519874:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2397:x1876607714308096:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672941.519947:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2397:x1876607714308096:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 74us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672941.519955:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 128 00000100:00100000:1.0:1789672941.519971:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 129 00000100:00100000:1.0:1789672941.519978:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2397:x1876607714307968:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672941.520002:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+8:2397:x1876607714307968:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672941.520023:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 129 00000100:00100000:1.0:1789672941.520042:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714307840 00000100:00100000:1.0:1789672941.520046:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714307840 00000100:00100000:1.0:1789672941.520072:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714308352 00000100:00100000:1.0:1789672941.520075:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714308352 00000100:00100000:1.0:1789672941.520087:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714307712 00000100:00100000:1.0:1789672941.520089:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714307712 00000100:00100000:1.0:1789672941.520100:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714308224 00000100:00100000:1.0:1789672941.520102:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714308224 00000100:00100000:1.0:1789672941.520118:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 349 00000100:00100000:1.0:1789672941.520124:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714307840:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672941.520154:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714307840:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 30us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672941.520160:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 349 00000100:00100000:1.0:1789672941.520172:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 350 00000100:00100000:1.0:1789672941.520177:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714308352:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672941.520198:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714308352:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 21us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672941.520203:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 350 00000100:00100000:1.0:1789672941.520213:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 351 00000100:00100000:1.0:1789672941.520219:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+33:2397:x1876607714307712:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672941.520239:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+33:2397:x1876607714307712:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 20us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672941.520245:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 351 00000100:00100000:1.0:1789672941.520255:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 352 00000100:00100000:1.0:1789672941.520268:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714308224:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672941.520291:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714308224:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 24us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672941.520296:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 352 00000100:00080000:1.0:1789672941.520322:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789672941.520338:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789672941.520341:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672941.520343:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672941.520522:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714307584 00000100:00100000:3.0:1789672941.520527:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714307584 00000100:00100000:3.0:1789672941.520560:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 396 00000100:00100000:3.0:1789672941.520567:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714307584:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672941.520595:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714307584:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 29us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672941.520601:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 396 00010000:00010000:3.0:1789672941.769627:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672942.404003:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738473472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789672942.404077:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672942.404639:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738473472 00000100:00100000:0.0:1789672942.404651:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738473472 00000100:00100000:0.0:1789672942.404739:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789672942.404751:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738473472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789672942.404792:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789672942.404909:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738473472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 160us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672942.404916:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789672942.409767:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738473472:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789672942.790197:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789672942.920540:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1789672942.920563:0:9507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000040:00080000:3.0:1789672943.556319:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789672943.556335:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789672943.556361:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789672943.556516:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789672943.811867:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672943.940241:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738473600:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.940351:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672943.940510:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738474112:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.940540:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672943.940560:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738474624:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.940584:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672943.940599:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738475136:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.940644:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672943.940694:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789672943.940700:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738473728:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.940724:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672943.940740:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738474240:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.940760:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672943.940777:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738474752:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.940801:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672943.940831:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738473984:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.940853:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672943.940867:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738474496:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.940884:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672943.940898:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738475008:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.940916:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672943.940931:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789672943.940937:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738473856:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.940958:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672943.940978:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738474368:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.940999:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672943.941014:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876607738474880:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.941033:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672943.941055:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738473600 00000100:00100000:0.0:1789672943.941062:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738473600 00000100:00100000:0.0:1789672943.941106:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1789672943.941115:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3635:x1876607738473600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.941175:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3635:x1876607738473600:12345-0@lo:400:kworker.0 Request processed in 61us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672943.941183:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1789672943.941213:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738474112 00000100:00100000:0.0:1789672943.941216:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738474112 00000100:00100000:0.0:1789672943.941237:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738473856 00000100:00100000:0.0:1789672943.941240:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738473856 00000100:00100000:0.0:1789672943.941254:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789672943.941260:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738474112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.941311:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738474112:12345-0@lo:400:kworker.0 Request processed in 50us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672943.941317:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789672943.941330:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789672943.941336:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738473856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.941366:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738473856:12345-0@lo:400:kworker.0 Request processed in 31us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672943.941372:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789672943.941390:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738473728 00000100:00100000:0.0:1789672943.941393:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738473728 00000100:00100000:0.0:1789672943.941412:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738474240 00000100:00100000:0.0:1789672943.941415:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738474240 00000100:00100000:0.0:1789672943.941436:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738474752 00000100:00100000:0.0:1789672943.941439:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738474752 00000100:00100000:0.0:1789672943.941459:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738473984 00000100:00100000:0.0:1789672943.941463:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738473984 00000100:00100000:0.0:1789672943.941475:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738474368 00000100:00100000:0.0:1789672943.941477:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738474368 00000100:00100000:0.0:1789672943.941488:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738474880 00000100:00100000:0.0:1789672943.941490:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738474880 00000100:00100000:0.0:1789672943.941513:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1789672943.941519:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738473728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.941548:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738473728:12345-0@lo:400:kworker.0 Request processed in 30us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672943.941554:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1789672943.941566:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789672943.941573:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738474240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.941600:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738474240:12345-0@lo:400:kworker.0 Request processed in 27us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672943.941607:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789672943.941619:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1789672943.941625:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738474752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.941651:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738474752:12345-0@lo:400:kworker.0 Request processed in 26us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672943.941679:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1789672943.941692:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1789672943.941698:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738473984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.941722:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738473984:12345-0@lo:400:kworker.0 Request processed in 25us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672943.941728:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1789672943.941738:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789672943.941743:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738474368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.941766:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738474368:12345-0@lo:400:kworker.0 Request processed in 23us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672943.941771:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789672943.941789:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1789672943.941796:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876607738474880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.941826:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876607738474880:12345-0@lo:400:kworker.0 Request processed in 31us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672943.941831:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1789672943.941878:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738473856:0@lo:400:kworker.0 00010000:00080000:0.0:1789672943.941891:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d93bb80 x1876607738474368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672943.941903:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738474368:0@lo:400:kworker.0 00010000:00080000:0.0:1789672943.941912:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d939f80 x1876607738474880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672943.941921:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876607738474880:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.941930:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738473984:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.941961:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738473728:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.941970:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738474240:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.941978:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738474752:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.941985:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738473600:0@lo:400:kworker.0 00000100:00100000:0.0:1789672943.941994:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738474112:0@lo:400:kworker.0 00000100:00100000:1.0:1789672943.942355:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738474624 00000100:00100000:1.0:1789672943.942362:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738474624 00000100:00100000:1.0:1789672943.942403:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738475136 00000100:00100000:1.0:1789672943.942407:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738475136 00000100:00100000:3.0:1789672943.942412:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738474496 00000100:00100000:3.0:1789672943.942419:0:8429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738474496 00000100:00100000:1.0:1789672943.942426:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738475008 00000100:00100000:1.0:1789672943.942431:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738475008 00000100:00100000:3.0:1789672943.942454:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789672943.942462:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789672943.942467:0:8429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3635:x1876607738474624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672943.942475:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc818f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738475136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672943.942914:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738475392:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789672943.943035:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672943.943039:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789672943.943042:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789672943.943044:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672943.943064:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789672943.943073:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789672943.943108:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738475264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672943.943185:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc818f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738475136:12345-0@lo:400:kworker.0 Request processed in 713us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672943.943192:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789672943.943208:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789672943.943215:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738474496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672943.943254:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738474496:12345-0@lo:400:kworker.0 Request processed in 40us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672943.943270:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789672943.943297:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789672943.943307:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738475008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672943.943345:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738475008:12345-0@lo:400:kworker.0 Request processed in 41us (2427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672943.943351:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789672943.943447:0:8429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3635:x1876607738474624:12345-0@lo:400:kworker.0 Request processed in 984us (2861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672943.943455:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789672943.943534:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738474624:0@lo:400:kworker.0 00000100:00100000:1.0:1789672943.943546:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1789672943.943552:0:3635:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1789672943.943576:0:3635:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfc7c404000, transno 4294967311 00000100:00100000:1.0:1789672943.943590:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738475136:0@lo:400:kworker.0 00000100:00100000:3.0:1789672943.943948:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738474496:0@lo:400:kworker.0 00000100:00100000:3.0:1789672943.943965:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738475008:0@lo:400:kworker.0 00000100:00100000:2.0:1789672943.944167:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672943.944203:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738475392 00000100:00100000:2.0:1789672943.944209:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738475392 00000100:00100000:0.0:1789672943.944240:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672943.944249:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789672943.944258:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738475392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789672943.944279:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672943.944302:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738475264 00000100:00100000:0.0:1789672943.944307:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738475264 00000100:00100000:0.0:1789672943.944329:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789672943.944335:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738475392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672943.944341:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738475264:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672943.944347:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00002000:00000024:0.0:1789672943.944356:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672943.944388:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738475392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789672943.944542:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738475264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 205us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672943.944549:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000001:00080000:1.0:1789672943.945727:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1789672943.945740:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000004:00080000:0.0:1789672943.945794:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:0.0:1789672943.945823:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1789672943.945847:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cfb4687fd80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789672943.945852:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc81a1ff00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cfb4687fc00 00000020:00080000:0.0:1789672943.945856:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cfc81a1f400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cfb480f4600 00000100:00100000:2.0:1789672943.945888:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738475264:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789672943.946017:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9966047 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672943.946032:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9966047 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672943.946040:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9966047 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672943.946046:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cca00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789672943.946052:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9966047 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672943.946061:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9966047 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672943.946079:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8cfb419b1300) 00010000:00010000:3.0:1789672943.946082:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789672943.946087:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9966047 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672943.946094:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cca00/0x6c78c4f8c9966047 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789672943.946258:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:2.0:1789672943.946325:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789672943.946338:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738475520:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789672943.946532:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789672943.946613:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789672943.946711:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1789672943.946834:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738475520 00000100:00100000:0.0:1789672943.946841:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738475520 00000100:00100000:0.0:1789672943.947029:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789672943.947040:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738475520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789672943.947153:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789672943.947157:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789672936 -> 1789672936 00002000:00010000:0.0:1789672943.947159:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 1789672935 -> 1789672935 00002000:00010000:0.0:1789672943.947162:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789672936 -> 1789672936 00002000:00010000:0.0:1789672943.947164:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789672943.947231:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1876607738475520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 189us (694us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789672943.947239:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789672943.947276:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1789672943.947297:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfc7f678a80, transno 4294967322 00000004:00080000:2.0:1789672943.947313:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1789672943.947334:0:3637:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cfc7c404000 x1876607738475520/t4294967325(4294967325) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789672959 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789672943.947355:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfc7c404000/2, rc 0, transno 4294967325 00000100:00100000:2.0:1789672943.947360:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738475520:0@lo:2:osp-syn-0-0.0 00000040:00080000:0.0:1789672944.453288:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789672944.842737:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672945.156596:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672945.156715:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714308480 00000100:00100000:0.0:1789672945.156725:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714308480 00000100:00100000:0.0:1789672945.156818:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 254 00000100:00100000:0.0:1789672945.156831:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:12162:x1876607714308480:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789672945.156976:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:12162:x1876607714308480:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 Request processed in 148us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672945.156984:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 254 00000100:00080000:1.0:1789672945.157157:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672945.159397:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672945.159787:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714308608 00000100:00100000:2.0:1789672945.160536:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714308608 00000100:00080000:1.0:1789672945.160742:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789672945.160782:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 255 00000100:00100000:3.0:1789672945.160795:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:12162:x1876607714308608:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789672945.160917:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:12162:x1876607714308608:12345-192.168.201.50@tcp:60:lhsmtool_posix.0 Request processed in 125us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672945.160953:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 255 00000100:00100000:3.0:1789672945.173901:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672945.177175:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714308864 00000100:00100000:1.0:1789672945.177192:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714308864 00000100:00100000:1.0:1789672945.177280:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:1.0:1789672945.177292:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:12162:x1876607714308864:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789672945.177791:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:12162:x1876607714308864:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 501us (3899us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789672945.177814:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 65 00000100:00100000:1.0:1789672945.477377:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738475648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789672945.477449:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672945.477604:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738475648 00000100:00100000:2.0:1789672945.477613:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738475648 00000100:00100000:2.0:1789672945.477694:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789672945.477706:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738475648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789672945.477735:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789672945.477782:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738475648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672945.477789:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1789672945.477884:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789672945.477935:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738475648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789672945.478271:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738475776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789672945.478307:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672945.478410:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738475776 00000100:00100000:3.0:1789672945.478416:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738475776 00000100:00100000:3.0:1789672945.478459:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789672945.478467:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1876607738475776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789672945.478479:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789672945.478521:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1876607738475776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672945.478528:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1789672945.478577:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789672945.478631:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738475776:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789672945.859925:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672946.500585:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738475904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789672946.500675:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672946.501353:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738475904 00000100:00100000:2.0:1789672946.501363:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738475904 00000100:00100000:2.0:1789672946.501406:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789672946.501413:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738475904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789672946.501443:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789672946.501602:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738475904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 188us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672946.501610:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789672946.501697:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738475904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789672946.640219:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672946.640275:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672946.640309:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672946.640342:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672946.640367:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672946.640514:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714309376 00000100:00100000:0.0:1789672946.640524:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714309376 00000100:00100000:0.0:1789672946.640586:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 134 00000100:00100000:0.0:1789672946.640598:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2397:x1876607714309376:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672946.640691:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714309120 00000100:00100000:3.0:1789672946.640703:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714309120 00000100:00100000:0.0:1789672946.640715:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2397:x1876607714309376:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 118us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672946.640724:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 134 00000100:00100000:3.0:1789672946.640741:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714309632 00000100:00100000:3.0:1789672946.640746:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714309632 00000100:00080000:0.0:1789672946.640766:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789672946.640770:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714309248 00000100:00080000:0.0:1789672946.640773:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672946.640775:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714309248 00000100:00100000:3.0:1789672946.640797:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 359 00000100:00100000:3.0:1789672946.640806:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:2397:x1876607714309120:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672946.640811:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714308992 00000100:00100000:0.0:1789672946.640816:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714308992 00000100:00100000:0.0:1789672946.640846:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 398 00000100:00100000:3.0:1789672946.640854:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:2397:x1876607714309120:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 47us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672946.640857:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714308992:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672946.640868:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 359 00000100:00100000:3.0:1789672946.640888:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 360 00000100:00100000:0.0:1789672946.640893:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2397:x1876607714308992:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 37us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672946.640901:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714309632:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672946.640905:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 398 00000100:00100000:3.0:1789672946.640939:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714309632:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 42us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672946.640958:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 360 00000100:00100000:3.0:1789672946.640973:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 361 00000100:00100000:3.0:1789672946.640979:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714309248:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672946.641005:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714309248:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 26us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672946.641011:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 361 00000100:00100000:1.0:1789672946.641190:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672946.641294:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672946.641389:0:14868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714309504 00000100:00100000:2.0:1789672946.641394:0:14868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714309504 00000100:00100000:2.0:1789672946.641437:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 135 00000100:00100000:2.0:1789672946.641445:0:14868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714309504:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789672946.641475:0:14868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2397:x1876607714309504:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 32us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672946.641492:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 135 00000100:00080000:1.0:1789672946.641702:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672946.641751:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714309760 00000100:00100000:3.0:1789672946.641756:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714309760 00000100:00100000:3.0:1789672946.641801:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 362 00000100:00100000:3.0:1789672946.641808:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714309760:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789672946.641836:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2397:x1876607714309760:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 29us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672946.641842:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 362 00000100:00080000:1.0:1789672946.641894:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789672946.883876:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789672947.424901:0:14954:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 15:22:24 (1789672944) 00000100:00100000:0.0:1789672947.524389:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672947.524413:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738476032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789672947.524503:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672947.524565:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738476032 00000100:00100000:0.0:1789672947.524573:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738476032 00000100:00100000:0.0:1789672947.524638:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789672947.524648:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738476032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789672947.524744:0:7834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789672947.525075:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738476032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 427us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672947.525083:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789672947.525424:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738476032:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789672947.907811:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672948.935352:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672949.060056:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738476160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789672949.060135:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672949.060898:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738476288:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.060934:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672949.060960:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738476800:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.060983:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672949.061001:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738477312:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.061022:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672949.061056:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789672949.061061:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738476672:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.061084:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672949.061102:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738477184:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.061120:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672949.061138:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738477696:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.061156:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672949.061179:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738476544:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.061225:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672949.061239:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738477056:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.061257:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672949.061285:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876607738477568:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.061305:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672949.061324:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789672949.061329:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738476416:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.061354:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672949.061370:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738476928:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.061387:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672949.061403:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738477440:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.061421:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672949.061444:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738476288 00000100:00100000:3.0:1789672949.061450:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738476288 00000100:00100000:3.0:1789672949.061495:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789672949.061504:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3636:x1876607738476288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.061554:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3636:x1876607738476288:12345-0@lo:400:kworker.0 Request processed in 50us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672949.061568:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789672949.061602:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738476800 00000100:00100000:3.0:1789672949.061606:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738476800 00000100:00100000:3.0:1789672949.061629:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738476544 00000100:00100000:3.0:1789672949.061632:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738476544 00000100:00100000:3.0:1789672949.061645:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789672949.061651:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738476800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.061706:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738476800:12345-0@lo:400:kworker.0 Request processed in 55us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672949.061712:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789672949.061724:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789672949.061729:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738476544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.061760:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738476544:12345-0@lo:400:kworker.0 Request processed in 31us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672949.061765:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789672949.061781:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738476672 00000100:00100000:3.0:1789672949.061784:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738476672 00000100:00100000:3.0:1789672949.061802:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738477056 00000100:00100000:3.0:1789672949.061805:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738477056 00000100:00100000:3.0:1789672949.061823:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738477568 00000100:00100000:3.0:1789672949.061825:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738477568 00000100:00100000:3.0:1789672949.061838:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738476416 00000100:00100000:3.0:1789672949.061841:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738476416 00000100:00100000:3.0:1789672949.061852:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738476928 00000100:00100000:3.0:1789672949.061854:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738476928 00000100:00100000:3.0:1789672949.061866:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738477440 00000100:00100000:3.0:1789672949.061867:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738477440 00000100:00100000:3.0:1789672949.061880:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789672949.061885:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738476672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.061921:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738476672:12345-0@lo:400:kworker.0 Request processed in 35us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672949.061926:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789672949.061940:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789672949.061946:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738477056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.061969:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738477056:12345-0@lo:400:kworker.0 Request processed in 24us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672949.061974:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789672949.061984:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1789672949.061989:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876607738477568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.062014:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876607738477568:12345-0@lo:400:kworker.0 Request processed in 25us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672949.062019:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1789672949.062030:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1789672949.062036:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738476416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.062060:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738476416:12345-0@lo:400:kworker.0 Request processed in 25us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672949.062066:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1789672949.062077:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789672949.062083:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738476928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.062108:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738476928:12345-0@lo:400:kworker.0 Request processed in 26us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672949.062113:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789672949.062124:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1789672949.062130:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738477440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.062165:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876607738477440:12345-0@lo:400:kworker.0 Request processed in 36us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672949.062170:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1789672949.062203:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738477312 00000100:00100000:3.0:1789672949.062206:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738477312 00000100:00100000:3.0:1789672949.062228:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738477184 00000100:00100000:3.0:1789672949.062230:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738477184 00000100:00100000:3.0:1789672949.062244:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738477696 00000100:00100000:3.0:1789672949.062247:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738477696 00000100:00100000:3.0:1789672949.062260:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789672949.062266:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1876607738477312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.062295:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1876607738477312:12345-0@lo:400:kworker.0 Request processed in 29us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672949.062300:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789672949.062310:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789672949.062316:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738477184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.062338:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738477184:12345-0@lo:400:kworker.0 Request processed in 22us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672949.062343:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789672949.062353:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789672949.062359:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738477696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.062384:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738477696:12345-0@lo:400:kworker.0 Request processed in 26us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672949.062390:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789672949.062458:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738476416:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.062468:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738476928:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.062486:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1876607738477440:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.062495:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738476544:0@lo:400:kworker.0 00010000:00080000:3.0:1789672949.062505:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f64b100 x1876607738477056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672949.062515:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738477056:0@lo:400:kworker.0 00010000:00080000:3.0:1789672949.062524:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f648e00 x1876607738477568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672949.062533:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876607738477568:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.062569:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738476672:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.062578:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738477184:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.062587:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738477696:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.062594:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738476288:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.062602:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738476800:0@lo:400:kworker.0 00000100:00100000:3.0:1789672949.062612:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738477312:0@lo:400:kworker.0 00000100:00100000:2.0:1789672949.063331:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738476160 00000100:00100000:2.0:1789672949.063339:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738476160 00000100:00100000:2.0:1789672949.063381:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789672949.063391:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738476160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789672949.063418:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672949.063476:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738476160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (3341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672949.063482:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789672949.063525:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738476160:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789672949.063820:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789672949.063824:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789672949.063827:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789672949.063829:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789672949.063848:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789672949.063858:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738477824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789672949.063891:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672949.063921:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738477824 00000100:00100000:1.0:1789672949.063925:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738477824 00000100:00100000:1.0:1789672949.063949:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789672949.063955:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738477824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789672949.063975:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789672949.064005:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738477824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672949.064010:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789672949.064038:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738477824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789672949.561960:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672949.562035:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714309888 00000100:00100000:3.0:1789672949.562046:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714309888 00000100:00100000:3.0:1789672949.562132:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 256 00000100:00100000:3.0:1789672949.562142:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:13182:x1876607714309888:12345-192.168.201.50@tcp:101:lsof.0 00010000:00010000:3.0:1789672949.562163:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1789672949.562258:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789672949.562296:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c99660d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd253a7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672949.562393:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c99660da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672949.562409:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c99660da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672949.562424:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c99660da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789672949.562475:0:6514:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789672949.562479:0:6514:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789672949.562637:0:6514:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c99660da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672949.562711:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5400/0x6c78c4f8c99660d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253a7 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672949.562731:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c99660da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253a7 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672949.562741:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc4991c100) 00010000:00010000:3.0:1789672949.562744:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789672949.562748:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e4c00, rc 0) 00000100:00100000:3.0:1789672949.562823:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:13182:x1876607714309888:12345-192.168.201.50@tcp:101:lsof.0 Request processed in 682us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672949.562830:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 256 00010000:00010000:3.0:1789672949.955930:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789672950.085951:0:8423:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1789672950.086279:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1789672950.086289:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1789672950.086482:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789672950.086556:0:6544:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1789672950.596156:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738477952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672950.596250:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672950.596343:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738477952 00000100:00100000:1.0:1789672950.596352:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738477952 00000100:00100000:1.0:1789672950.596401:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789672950.596410:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738477952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672950.596438:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789672950.597054:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1789672950.597059:0:3637:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cfc7c404000, transno 4294967325 00000100:00100000:0.0:1789672950.597081:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738477952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789672950.597895:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738477952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1483us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672950.597905:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789672950.598223:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738478080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789672950.598261:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672950.602386:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738478080 00000100:00100000:3.0:1789672950.602420:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738478080 00000100:00100000:3.0:1789672950.602616:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789672950.602625:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738478080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789672950.602648:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789672950.602737:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738478080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (4475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672950.602742:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789672950.602842:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738478080:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789672950.979960:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672951.467073:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672951.467183:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714310144 00000100:00100000:1.0:1789672951.467198:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714310144 00000100:00100000:1.0:1789672951.467347:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:1.0:1789672951.467359:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+19:13184:x1876607714310144:12345-192.168.201.50@tcp:35:umount.0 00000100:00080000:2.0:1789672951.467387:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789672951.468901:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:13184:x1876607714310144:12345-192.168.201.50@tcp:35:umount.0 Request processed in 1538us (1836us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789672951.468932:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 66 00000100:00100000:0.0:1789672951.472685:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672951.472773:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714310400 00000100:00100000:1.0:1789672951.472784:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714310400 00000100:00100000:1.0:1789672951.477609:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:1.0:1789672951.477633:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+20:13184:x1876607714310400:12345-192.168.201.50@tcp:35:umount.0 00000100:00100000:1.0:1789672951.478014:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:13184:x1876607714310400:12345-192.168.201.50@tcp:35:umount.0 Request processed in 391us (5359us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789672951.478023:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 67 00000100:00100000:2.0:1789672951.486141:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672951.486257:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714310656 00000100:00100000:1.0:1789672951.486269:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714310656 00000100:00100000:1.0:1789672951.486414:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:1.0:1789672951.486426:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f853450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+21:13184:x1876607714310656:12345-192.168.201.50@tcp:35:umount.0 00000100:00100000:1.0:1789672951.486885:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f853450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:13184:x1876607714310656:12345-192.168.201.50@tcp:35:umount.0 Request processed in 459us (754us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789672951.486894:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 68 00000100:00100000:0.0:1789672951.498584:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672951.500393:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714310912 00000100:00100000:1.0:1789672951.500408:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714310912 00000100:00100000:1.0:1789672951.500680:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:1.0:1789672951.500694:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:13184:x1876607714310912:12345-192.168.201.50@tcp:35:umount.0 00000100:00100000:1.0:1789672951.501034:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+23:13184:x1876607714310912:12345-192.168.201.50@tcp:35:umount.0 Request processed in 343us (2458us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1789672951.501042:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 69 00000100:00100000:2.0:1789672951.509040:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672951.509146:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672951.509244:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672951.509331:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714311168 00000100:00100000:1.0:1789672951.509345:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714311168 00000100:00100000:1.0:1789672951.509441:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714311424 00000100:00100000:1.0:1789672951.509445:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714311424 00000100:00100000:1.0:1789672951.509556:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:1.0:1789672951.509568:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e362d29-d6a4-4e54-8405-94913e6a9c61+14:2395:x1876607714311168:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672951.509586:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672951.509608:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8a0800/0x6c78c4f8c99650bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f01 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.509637:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672951.509731:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e362d29-d6a4-4e54-8405-94913e6a9c61+13:2395:x1876607714311168:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 165us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672951.509739:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:1.0:1789672951.509756:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:1.0:1789672951.509762:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e362d29-d6a4-4e54-8405-94913e6a9c61+12:2395:x1876607714311424:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672951.509770:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672951.509779:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d887600/0x6c78c4f8c9965312 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fda expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.509788:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672951.509807:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:2395:x1876607714311424:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 45us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672951.509814:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:2.0:1789672951.511865:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672951.511964:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714311040 00000100:00100000:0.0:1789672951.511973:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714311040 00000100:00100000:0.0:1789672951.512048:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 80 00000100:00100000:0.0:1789672951.512058:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2394:x1876607714311040:12345-192.168.201.50@tcp:9:umount.0 00000020:00000080:0.0:1789672951.512090:0:8428:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c99653dd 00000100:00080000:0.0:1789672951.512102:0:8428:0:(import.c:65:import_set_state_nolock()) ffff8cfb47a6d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789672951.512159:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789672951.512329:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+2:2394:x1876607714311040:12345-192.168.201.50@tcp:9:umount.0 Request processed in 272us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672951.512337:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 80 00010000:00010000:0.0:1789672951.512360:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672951.512555:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714311296 00000100:00100000:1.0:1789672951.512560:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714311296 00000100:00100000:1.0:1789672951.512608:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:1.0:1789672951.512616:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:2395:x1876607714311296:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789672951.512626:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789672951.512687:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d886e00/0x6c78c4f8c9965002 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24ec2 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.512703:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789672951.512726:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2395:x1876607714311296:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 111us (3482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672951.512733:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00080000:2.0:1789672951.512808:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789672951.518119:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672951.518258:0:14868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714311808 00000100:00100000:2.0:1789672951.518273:0:14868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714311808 00000100:00100000:2.0:1789672951.518381:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 81 00000100:00100000:2.0:1789672951.518394:0:14868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+7:2394:x1876607714311808:12345-192.168.201.50@tcp:9:umount.0 00000020:00000080:2.0:1789672951.518435:0:14868:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c996564c 00000020:00010000:2.0:1789672951.518445:0:14868:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cfb48119800: total 0 00000100:00080000:2.0:1789672951.518450:0:14868:0:(import.c:65:import_set_state_nolock()) ffff8cfb4811d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789672951.518588:0:14868:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789672951.518880:0:14868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2394:x1876607714311808:12345-192.168.201.50@tcp:9:umount.0 Request processed in 488us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672951.518889:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 81 00000020:00010000:0.0:1789672951.519333:0:13186:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cfb48119800: total 0 00010000:00010000:0.0:1789672951.519378:0:13186:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cfb48119800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789672951.519444:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033840ce9/0x6c78c4f8c99660cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253a0 expref: 4 pid: 8428 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672951.519559:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097739a6d/0x6c78c4f8c9965a0b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251c4 expref: 3 pid: 8494 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672951.519591:0:13186:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cfb48119800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789672951.519606:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672951.519608:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672951.519609:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789672951.519681:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789672951.527324:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789672951.527425:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714312832 00000100:00100000:3.0:1789672951.527436:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714312832 00000100:00100000:3.0:1789672951.527624:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 257 00000100:00100000:3.0:1789672951.527636:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+23:2394:x1876607714312832:12345-192.168.201.50@tcp:39:umount.0 00000020:00000080:3.0:1789672951.527730:0:11081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9965010 00000020:00010000:3.0:1789672951.527751:0:11081:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cfb4693f800: total 0 00000100:00080000:3.0:1789672951.527758:0:11081:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f578000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789672951.527791:0:11081:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1789672951.527972:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+22:2394:x1876607714312832:12345-192.168.201.50@tcp:39:umount.0 Request processed in 338us (660us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1789672951.527980:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 257 00000020:00010000:1.0:1789672951.528050:0:6500:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cfb4693f800: total 0 00010000:00010000:1.0:1789672951.528140:0:6500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cfb4693f800, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1789672951.528191:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:1.0:1789672951.528194:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789672951.528205:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cdc00/0x6c78c4f8c99656ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd250dd expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.528230:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672951.528232:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789672951.528236:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee800/0x6c78c4f8c996607f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2538b expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.528250:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfc61501100) 00010000:00010000:1.0:1789672951.528252:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789672951.528255:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0400/0x6c78c4f8c9965358 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fef expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.528272:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672951.528274:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789672951.528277:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef400/0x6c78c4f8c99660b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25399 expref: 18 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.528303:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:1.0:1789672951.528306:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789672951.528311:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887a00/0x6c78c4f8c99659f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251bd expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.528324:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:1.0:1789672951.528326:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789672951.528329:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1a00/0x6c78c4f8c9965d6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd252b9 expref: 16 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.528341:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc4991c100) 00010000:00010000:1.0:1789672951.528344:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672951.528347:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aee400/0x6c78c4f8c9965a66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251d9 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.528359:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cfc61501400) 00010000:00010000:1.0:1789672951.528362:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789672951.528366:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a1e00/0x6c78c4f8c996533c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fe8 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.528382:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:1.0:1789672951.528384:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672951.528388:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52435800/0x6c78c4f8c99658ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25177 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.528400:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8cfb46b95e00) 00010000:00010000:1.0:1789672951.528402:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789672951.528417:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8a0e00/0x6c78c4f8c99653b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25004 expref: 12 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.528431:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672951.528433:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789672951.528437:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aef000/0x6c78c4f8c9965fad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25353 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.528448:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8cfc821d4900) 00010000:00010000:1.0:1789672951.528450:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672951.528453:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5a00/0x6c78c4f8c99660a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25392 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.528544:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8cfc4991c500) 00010000:00010000:1.0:1789672951.528547:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789672951.528552:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb46aeea00/0x6c78c4f8c99659cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251af expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.528569:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8cfb419b1b00) 00010000:00010000:1.0:1789672951.528572:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789672951.528576:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc52434800/0x6c78c4f8c9965a82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd251e0 expref: 8 pid: 11081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672951.528589:0:6500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cfb4693f800, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1789672951.528605:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672951.528607:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672951.528610:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672951.543070:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672951.543800:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714312960 00000100:00100000:0.0:1789672951.543814:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714312960 00000100:00100000:0.0:1789672951.543927:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 258 00000100:00100000:0.0:1789672951.543943:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+5:2394:x1876607714312960:12345-192.168.201.50@tcp:39:umount.0 00000020:00000080:0.0:1789672951.543996:0:9524:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9965017 00000100:00080000:0.0:1789672951.544022:0:9524:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f57c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789672951.544056:0:9524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789672951.544322:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad795a16-0aa4-4e04-82a0-6f12aab5f2ea+3:2394:x1876607714312960:12345-192.168.201.50@tcp:39:umount.0 Request processed in 383us (1268us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789672951.544330:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 258 00010000:00010000:0.0:1789672951.544367:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789672951.544557:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789672951.619817:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789672951.619846:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738478208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789672951.619916:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672951.619990:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738478208 00000100:00100000:0.0:1789672951.619998:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738478208 00000100:00100000:0.0:1789672951.620051:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789672951.620059:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738478208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789672951.620096:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789672951.620209:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738478208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672951.620236:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789672951.620283:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738478208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789672951.767522:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672951.767562:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672951.767592:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789672951.767691:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714313344 00000100:00100000:1.0:1789672951.767714:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714313344 00000100:00100000:1.0:1789672951.767772:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714313216 00000100:00100000:1.0:1789672951.767774:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714313216 00000100:00100000:1.0:1789672951.767792:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 369 00000100:00100000:1.0:1789672951.767801:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714313344:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672951.767864:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2396:x1876607714313344:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 65us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672951.767871:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 369 00000100:00100000:1.0:1789672951.767886:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 370 00000100:00100000:1.0:1789672951.767891:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:2396:x1876607714313216:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789672951.767909:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:2396:x1876607714313216:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 18us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672951.767914:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 370 00000100:00080000:2.0:1789672951.767965:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789672951.767968:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789672951.768607:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714313088 00000100:00100000:0.0:1789672951.768614:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714313088 00000100:00100000:0.0:1789672951.768688:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 400 00000100:00100000:0.0:1789672951.768698:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2396:x1876607714313088:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789672951.768737:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2396:x1876607714313088:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 42us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672951.768743:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 400 00010000:00010000:0.0:1789672952.007226:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672952.645612:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672952.645635:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738478336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789672952.645730:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672952.645876:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738478336 00000100:00100000:0.0:1789672952.645886:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738478336 00000100:00100000:0.0:1789672952.645940:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789672952.645950:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738478336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789672952.645984:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789672952.646037:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738478336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672952.646043:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789672952.646104:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738478336:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789672953.028302:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789672953.795873:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789672953.795882:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789672953.795984:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789672953.795991:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789672954.052970:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672954.127414:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672954.127512:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672954.132024:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672954.133047:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714313600 00000100:00100000:0.0:1789672954.133082:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714313600 00000100:00100000:0.0:1789672954.137550:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714313472 00000100:00100000:0.0:1789672954.137561:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714313472 00000100:00100000:0.0:1789672954.137598:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:3.0:1789672954.137754:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:3.0:1789672954.137766:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e362d29-d6a4-4e54-8405-94913e6a9c61+11:2398:x1876607714313472:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672954.137782:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672954.137801:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8a0c00/0x6c78c4f8c9965113 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f16 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672954.137817:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672954.137878:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e362d29-d6a4-4e54-8405-94913e6a9c61+10:2398:x1876607714313472:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 116us (10366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672954.137899:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:0.0:1789672954.138544:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e362d29-d6a4-4e54-8405-94913e6a9c61+9:2398:x1876607714313600:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789672954.138556:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672954.138566:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8a1800/0x6c78c4f8c996511a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f47 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672954.138576:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672954.138605:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e362d29-d6a4-4e54-8405-94913e6a9c61+8:2398:x1876607714313600:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 999us (11203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672954.138773:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:3.0:1789672954.138996:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714313728 00000100:00100000:3.0:1789672954.139002:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714313728 00000100:00100000:3.0:1789672954.139041:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:3.0:1789672954.139049:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f86b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e362d29-d6a4-4e54-8405-94913e6a9c61+8:2398:x1876607714313728:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789672954.139385:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672954.139398:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc61609600/0x6c78c4f8c99652ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24fd3 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672954.139409:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672954.139444:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f86b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e362d29-d6a4-4e54-8405-94913e6a9c61+7:2398:x1876607714313728:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 396us (7430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672954.139451:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:3.0:1789672954.157432:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672954.157525:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714313984 00000100:00100000:0.0:1789672954.157535:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714313984 00000100:00100000:0.0:1789672954.157620:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 259 00000100:00100000:0.0:1789672954.157633:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+6:2394:x1876607714313984:12345-192.168.201.50@tcp:39:umount.0 00000020:00000080:0.0:1789672954.157695:0:6513:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9965128 00000020:00010000:0.0:1789672954.157705:0:6513:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cfc7f57e000: total 0 00000100:00080000:0.0:1789672954.157710:0:6513:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f57b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789672954.157735:0:6513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1789672954.157888:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2394:x1876607714313984:12345-192.168.201.50@tcp:39:umount.0 Request processed in 258us (650us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1789672954.157895:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 259 00000100:00080000:2.0:1789672954.158544:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1789672954.158628:0:13186:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cfc7f57e000: total 0 00010000:00010000:3.0:1789672954.158633:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672954.158711:0:13186:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cfc7f57e000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789672954.158746:0:13186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc4991c100) 00010000:00010000:3.0:1789672954.158750:0:13186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789672954.158759:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4c00/0x6c78c4f8c99660da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253a7 expref: 4 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672954.158781:0:13186:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cfc7f57e000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789672954.158793:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672954.158795:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672954.158796:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672954.165731:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789672954.165818:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714314112 00000100:00100000:0.0:1789672954.165829:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714314112 00000100:00100000:0.0:1789672954.165913:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 260 00000100:00100000:0.0:1789672954.165926:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+5:2394:x1876607714314112:12345-192.168.201.50@tcp:39:umount.0 00000020:00000080:0.0:1789672954.165974:0:9524:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c996512f 00000100:00080000:0.0:1789672954.165983:0:9524:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f57c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789672954.166014:0:9524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789672954.166225:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33c1cd4d-7765-4bf5-8421-437f0a05573b+3:2394:x1876607714314112:12345-192.168.201.50@tcp:39:umount.0 Request processed in 302us (505us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789672954.166233:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 260 00010000:00010000:1.0:1789672954.166449:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789672954.166860:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789672954.180876:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672954.180909:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738478464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789672954.180978:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672954.181524:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738478720:0@lo:400:kworker.0 00000100:00100000:2.0:1789672954.181558:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672954.181586:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738479232:0@lo:400:kworker.0 00000100:00100000:2.0:1789672954.181620:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672954.181636:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738479744:0@lo:400:kworker.0 00000100:00100000:2.0:1789672954.181653:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672954.181691:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789672954.181696:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738478848:0@lo:400:kworker.0 00000100:00100000:2.0:1789672954.181716:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672954.181748:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738479360:0@lo:400:kworker.0 00000100:00100000:2.0:1789672954.181768:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672954.181785:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738479872:0@lo:400:kworker.0 00000100:00100000:2.0:1789672954.181803:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672954.181831:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738478848 00000100:00100000:2.0:1789672954.181839:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738478848 00000100:00100000:2.0:1789672954.181883:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789672954.181891:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738478848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672954.181939:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738478848:12345-0@lo:400:kworker.0 Request processed in 49us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672954.181946:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789672954.181968:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738478720 00000100:00100000:2.0:1789672954.181972:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738478720 00000100:00100000:2.0:1789672954.181987:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738479232 00000100:00100000:2.0:1789672954.181989:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738479232 00000100:00100000:2.0:1789672954.182008:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738479744 00000100:00100000:2.0:1789672954.182010:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738479744 00000100:00100000:2.0:1789672954.182021:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738479360 00000100:00100000:2.0:1789672954.182023:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738479360 00000100:00100000:2.0:1789672954.182032:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738479872 00000100:00100000:2.0:1789672954.182034:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738479872 00000100:00100000:2.0:1789672954.182044:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789672954.182049:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738478720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672954.182074:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738478720:12345-0@lo:400:kworker.0 Request processed in 25us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672954.182080:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789672954.182090:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789672954.182096:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738479232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672954.182142:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738479232:12345-0@lo:400:kworker.0 Request processed in 46us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672954.182148:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789672954.182158:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789672954.182163:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738479744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672954.182187:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738479744:12345-0@lo:400:kworker.0 Request processed in 24us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672954.182192:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789672954.182202:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1789672954.182208:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738479360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672954.182485:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738478592:0@lo:400:kworker.0 00000100:00100000:2.0:1789672954.182599:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738479360:12345-0@lo:400:kworker.0 Request processed in 391us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672954.182621:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1789672954.182634:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1789672954.182640:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738479872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672954.182702:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738478464 00000100:00100000:1.0:1789672954.182706:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738478464 00000100:00100000:1.0:1789672954.182743:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789672954.182750:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738478464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789672954.182771:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789672954.182905:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738478976:0@lo:400:kworker.0 00000100:00100000:0.0:1789672954.186536:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672954.186598:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738479104:0@lo:400:kworker.0 00000100:00100000:0.0:1789672954.188257:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672954.188296:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738479616:0@lo:400:kworker.0 00000100:00100000:0.0:1789672954.188328:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672954.188367:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738480128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789672954.188389:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672954.188434:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738478592 00000100:00100000:0.0:1789672954.188443:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738478592 00000100:00100000:0.0:1789672954.188486:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789672954.188494:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738478592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672954.188543:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738478592:12345-0@lo:400:kworker.0 Request processed in 50us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672954.188550:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789672954.188586:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738479104 00000100:00100000:0.0:1789672954.188590:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738479104 00000100:00100000:0.0:1789672954.188614:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789672954.188620:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738479104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672954.188696:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738479104:12345-0@lo:400:kworker.0 Request processed in 75us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672954.188703:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789672954.188721:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738480128 00000100:00100000:0.0:1789672954.188725:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738480128 00000100:00100000:0.0:1789672954.188757:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789672954.188763:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738480128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789672954.188778:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789672954.188818:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738480128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672954.188824:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789672954.188871:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738480128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789672954.188881:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738478592:0@lo:400:kworker.0 00000100:00100000:0.0:1789672954.188890:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738479104:0@lo:400:kworker.0 00000100:00100000:0.0:1789672954.188932:0:8494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738479616 00000100:00100000:0.0:1789672954.188935:0:8494:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738479616 00000100:00100000:0.0:1789672954.188959:0:8494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789672954.188965:0:8494:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738479616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789672954.188995:0:8494:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738479616:12345-0@lo:400:kworker.0 Request processed in 31us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672954.189001:0:8494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789672954.189024:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738479616:0@lo:400:kworker.0 00000100:00080000:0.0:1789672954.189054:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789672954.189058:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789672954.189060:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789672954.189068:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789672954.189089:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738478848:0@lo:400:kworker.0 00010000:00080000:0.0:1789672954.189118:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb48076680 x1876607738479360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672954.189130:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738479360:0@lo:400:kworker.0 00000100:00100000:0.0:1789672954.189142:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738478720:0@lo:400:kworker.0 00000100:00100000:0.0:1789672954.189152:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738479232:0@lo:400:kworker.0 00000100:00100000:0.0:1789672954.189161:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738479744:0@lo:400:kworker.0 00000100:00100000:2.0:1789672954.189918:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738479872:12345-0@lo:400:kworker.0 Request processed in 7274us (8109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672954.189930:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789672954.193390:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738478464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10631us (12402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672954.193404:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789672954.193545:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738478464:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789672954.194054:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb48076300 x1876607738479872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672954.194066:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738479872:0@lo:400:kworker.0 00000100:00100000:3.0:1789672954.194280:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672954.194354:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738479488:0@lo:400:kworker.0 00000100:00100000:3.0:1789672954.194390:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672954.194418:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738480000:0@lo:400:kworker.0 00000100:00100000:3.0:1789672954.194436:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672954.194511:0:14868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738479488 00000100:00100000:2.0:1789672954.194517:0:14868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738479488 00000100:00100000:2.0:1789672954.194567:0:14868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738480000 00000100:00100000:2.0:1789672954.194570:0:14868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738480000 00000100:00100000:2.0:1789672954.194589:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789672954.194596:0:14868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738479488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672954.194676:0:14868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738479488:12345-0@lo:400:kworker.0 Request processed in 80us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672954.194683:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789672954.194696:0:14868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789672954.194701:0:14868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738480000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672954.194728:0:14868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738480000:12345-0@lo:400:kworker.0 Request processed in 26us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672954.194734:0:14868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1789672954.195084:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672954.195114:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738479488:0@lo:400:kworker.0 00000100:00100000:3.0:1789672954.195124:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738480000:0@lo:400:kworker.0 00000100:00100000:0.0:1789672954.195317:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738478976 00000100:00100000:0.0:1789672954.195321:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738478976 00000100:00100000:1.0:1789672954.195457:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789672954.195465:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738478976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789672954.195510:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738478976:12345-0@lo:400:kworker.0 Request processed in 46us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672954.195523:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1789672954.195574:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738478976:0@lo:400:kworker.0 00000100:00100000:0.0:1789672954.202362:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789672954.202464:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714314368 00000100:00100000:2.0:1789672954.202476:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714314368 00000100:00100000:2.0:1789672954.202559:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 402 00000100:00100000:2.0:1789672954.202571:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc747f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+7:2394:x1876607714314368:12345-192.168.201.50@tcp:251:umount.0 00000020:00000080:2.0:1789672954.202618:0:6506:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964fed 00000020:00010000:2.0:1789672954.202627:0:6506:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cfb46938800: total 0 00000100:00080000:2.0:1789672954.202632:0:6506:0:(import.c:65:import_set_state_nolock()) ffff8cfb4693e000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789672954.202756:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc747f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e362d29-d6a4-4e54-8405-94913e6a9c61+3:2394:x1876607714314368:12345-192.168.201.50@tcp:251:umount.0 Request processed in 187us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672954.202764:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 402 00000020:00010000:1.0:1789672954.202829:0:6499:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cfb46938800: total 0 00010000:00010000:1.0:1789672954.202884:0:6499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cfb46938800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789672954.202916:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d887e00/0x6c78c4f8c99650c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd24f08 expref: 2 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672954.202934:0:6499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cfb46938800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789672954.202943:0:6499:0:(genops.c:885:class_export_put()) final put ffff8cfb46938800/6e362d29-d6a4-4e54-8405-94913e6a9c61 00010000:00010000:1.0:1789672954.202956:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672954.202958:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672954.202960:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789672954.202969:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb46938800/6e362d29-d6a4-4e54-8405-94913e6a9c61 for MGS 00000020:00000080:1.0:1789672954.203005:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb4693e000 for MGS 00000040:00080000:2.0:1789672954.692558:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789672955.085138:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672955.716402:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738480256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789672955.716471:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672955.716544:0:10094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738480256 00000100:00100000:2.0:1789672955.716553:0:10094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738480256 00000100:00100000:2.0:1789672955.716603:0:10094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789672955.716613:0:10094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb48074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738480256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789672955.716641:0:10094:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789672955.716711:0:10094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb48074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738480256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672955.716718:0:10094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789672955.716866:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738480384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789672955.716897:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672955.717133:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738480384 00000100:00100000:1.0:1789672955.717138:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738480384 00000100:00100000:1.0:1789672955.717182:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789672955.717189:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738480384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789672955.717199:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789672955.717231:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738480384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672955.717237:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789672955.717709:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738480384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789672955.717781:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738480256:0@lo:13:osp-pre-0-1.0 00000020:01000004:2.0:1789672955.850369:0:15150:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789672955.868846:0:15150:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789672955.868912:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996509c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.868929:0:15150:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996509c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.868936:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c996509c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.868944:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c996509c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.868966:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789672955.868972:0:15150:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789672955.868996:0:15150:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789672955.869001:0:15150:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789672955.869007:0:15150:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789672955.869032:0:15150:0:(import.c:65:import_set_state_nolock()) ffff8cfc462e2800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789672955.869109:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672955.869117:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c996509c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.869125:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61609e00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:3.0:1789672955.869128:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c996509c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.869151:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c996509c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672955.869157:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c996509c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672955.869163:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789672955.869165:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789672955.869168:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789672955.869192:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c996509c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.869199:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789672955.869235:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c996509c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.869243:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc61609e00/0x6c78c4f8c9965095 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c996509c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.869254:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672955.869256:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672955.869258:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672955.869266:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789672955.869284:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738480640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789672955.869350:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672955.870080:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876607738480512:0@lo:39:umount.0 00000100:00100000:0.0:1789672955.870117:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672955.870197:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738480640 00000100:00100000:0.0:1789672955.870204:0:6496:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738480640 00000100:00100000:0.0:1789672955.870264:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789672955.870273:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c404000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3638:x1876607738480640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789672955.870285:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789672955.870301:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d887800/0x6c78c4f8c996509c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c9965095 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672955.870327:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789672955.870364:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c404000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:3638:x1876607738480640:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789672955.870371:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789672955.870409:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3638:1876607738480640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672955.870550:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738480512 00000100:00100000:2.0:1789672955.870554:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738480512 00000100:00100000:2.0:1789672955.870624:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789672955.870632:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876607738480512:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789672955.870682:0:6514:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964c04 00000100:00080000:2.0:1789672955.870698:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c2000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789672955.870754:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3634:x1876607738480512:12345-0@lo:39:umount.0 Request processed in 123us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672955.870761:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:2.0:1789672955.870767:0:6514:0:(genops.c:885:class_export_put()) final put ffff8cfc44209800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1789672955.870822:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789672955.870842:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc462e2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789672955.870853:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876607738480512:0@lo:39:umount.0 00000020:00000080:1.0:1789672955.872031:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc44209800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789672955.872098:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc458c2000 for lustre-MDT0000 00000100:00080000:2.0:1789672955.873628:0:15150:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789672955.873635:0:15150:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789672955.873643:0:15150:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789672955.876028:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99650aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.876047:0:15150:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99650aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.876054:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c99650aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.876062:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c99650aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.876094:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789672955.876100:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964fae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.876107:0:15150:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964fae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.876113:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9964fae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.876120:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9964fae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.876149:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789672955.876155:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996530b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.876161:0:15150:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996530b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.876166:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c996530b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.876172:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c996530b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.876183:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789672955.876188:0:15150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608000/0x6c78c4f8c9964b63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964b6a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.876194:0:15150:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608000/0x6c78c4f8c9964b63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964b6a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.876200:0:15150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608000/0x6c78c4f8c9964b63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9964b6a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.876205:0:15150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc61608000/0x6c78c4f8c9964b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9964b6a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.876212:0:15150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1789672955.876216:0:15150:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789672955.876251:0:15150:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789672955.876256:0:15150:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789672955.876261:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789672955.876266:0:15150:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1789672955.876274:0:15150:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8cfb46bf4800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789672955.876279:0:15150:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8cfb4676a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789672955.876283:0:15150:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8cfc7c566000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789672955.876287:0:15150:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8cfc81477000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1789672955.876294:0:15150:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8cfc7f57e000 33c1cd4d-7765-4bf5-8421-437f0a05573b 192.168.201.50@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789672955.876299:0:15150:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8cfb4693f800 ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 192.168.201.50@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1789672955.876304:0:15150:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8cfc499c99c0) has exports, disconnecting them 00000020:00080000:2.0:1789672955.876308:0:15150:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cfb46bf4800), last request at 1789672954 00000020:00000080:2.0:1789672955.876317:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964f14 00000100:00080000:2.0:1789672955.876335:0:15150:0:(import.c:65:import_set_state_nolock()) ffff8cfb46bf7800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789672955.876423:0:13186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789672955.876431:0:13186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c99650aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672955.876438:0:13186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc40031600 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789672955.876442:0:13186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c99650aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672955.876450:0:13186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c99650aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672955.876456:0:13186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c99650aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672955.876461:0:13186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789672955.876464:0:13186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1789672955.876466:0:13186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1789672955.876502:0:13186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c99650aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672955.876517:0:13186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789672955.876541:0:13186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c99650aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672955.876547:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc40031600/0x6c78c4f8c99650a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c99650aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.876784:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789672955.876790:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9964fae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.876807:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435e00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:3.0:1789672955.876811:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9964fae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.876817:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c9964fae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672955.876822:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c9964fae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672955.876826:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789672955.876828:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789672955.876831:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789672955.876846:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c9964fae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.876852:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789672955.876871:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c9964fae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.876877:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c9964fa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c9964fae expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.876887:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789672955.876890:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c996530b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.876895:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61609a00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:3.0:1789672955.876897:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c996530b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.876908:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c996530b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672955.876914:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c996530b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672955.876918:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789672955.876920:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789672955.876922:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789672955.876934:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c996530b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.876940:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789672955.876946:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c996530b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.876952:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc61609a00/0x6c78c4f8c9965304 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c996530b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.876960:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672955.876962:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc61608000/0x6c78c4f8c9964b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9964b6a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.876967:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61608000 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:3.0:1789672955.876970:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61608000/0x6c78c4f8c9964b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9964b6a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.876976:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc61608000/0x6c78c4f8c9964b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c9964b6a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672955.876990:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61608000/0x6c78c4f8c9964b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c9964b6a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672955.876995:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789672955.876997:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789672955.876998:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789672955.877010:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc61608000/0x6c78c4f8c9964b63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c9964b6a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.877015:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789672955.877021:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc61608000/0x6c78c4f8c9964b63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c9964b6a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.877027:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc61608000/0x6c78c4f8c9964b63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c9964b6a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.877036:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672955.877038:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672955.877039:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672955.877054:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738481024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789672955.877136:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672955.877184:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789672955.877190:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738480896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789672955.877223:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672955.877253:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738481024 00000100:00100000:3.0:1789672955.877259:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738481024 00000100:00100000:3.0:1789672955.877300:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738480896 00000100:00100000:3.0:1789672955.877303:0:7920:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738480896 00000100:00100000:3.0:1789672955.877324:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789672955.877338:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+24:3636:x1876607738481024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789672955.877351:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672955.877364:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc61608a00/0x6c78c4f8c996530b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c9965304 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.877376:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672955.877410:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+23:3636:x1876607738481024:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672955.877417:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789672955.877434:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789672955.877440:0:7920:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:3636:x1876607738480896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789672955.877448:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789672955.877456:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8a1400/0x6c78c4f8c9964fae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c9964fa7 expref: 22 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672955.877464:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789672955.877484:0:7920:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3636:x1876607738480896:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672955.877490:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789672955.877527:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738480896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789672955.877536:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738481024:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789672955.878118:0:15150:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfb46bf4800): rc 0 00000020:00000080:3.0:1789672955.878122:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfb46bf4800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789672955.878136:0:15150:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cfb4676a800), last request at 1789672954 00000020:00000080:3.0:1789672955.878141:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964dee 00000100:00080000:3.0:1789672955.878150:0:15150:0:(import.c:65:import_set_state_nolock()) ffff8cfb4676c800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789672955.878177:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb46bf4800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789672955.878229:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb46bf7800 for lustre-MDT0000 00010000:00010000:3.0:1789672955.878239:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789672955.878247:0:15150:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfb4676a800): rc 0 00000020:00000080:3.0:1789672955.878250:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfb4676a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1789672955.878258:0:15150:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cfc7c566000), last request at 1789672712 00000020:00000080:3.0:1789672955.878261:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964ceb 00000100:00080000:3.0:1789672955.878265:0:15150:0:(import.c:65:import_set_state_nolock()) ffff8cfc7c560800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789672955.878274:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb4676a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789672955.878298:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb4676c800 for lustre-MDT0000 00010000:00010000:3.0:1789672955.878305:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789672955.878312:0:15150:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfc7c566000): rc 0 00000020:00000080:3.0:1789672955.878314:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc7c566000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1789672955.878320:0:15150:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cfc81477000), last request at 1789672712 00000020:00000080:3.0:1789672955.878324:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964cac 00000100:00080000:3.0:1789672955.878327:0:15150:0:(import.c:65:import_set_state_nolock()) ffff8cfc81474000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789672955.878337:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c566000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789672955.878359:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc7c560800 for lustre-MDT0000 00010000:00010000:3.0:1789672955.878367:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789672955.878373:0:15150:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:3.0:1789672955.878450:0:15150:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfc81477000): rc 0 00000004:00000080:3.0:1789672955.878456:0:15150:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac6d81677ae0 00000100:00080000:3.0:1789672955.878473:0:15150:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789672955.878477:0:15150:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1789672955.879230:0:15150:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789672955.879253:0:15150:0:(import.c:65:import_set_state_nolock()) ffff8cfc816a0000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789672955.879515:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738481152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789672955.879569:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672955.879607:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789672955.879613:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738480768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789672955.879634:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672955.879789:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738481152 00000100:00100000:2.0:1789672955.879796:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738481152 00000100:00100000:2.0:1789672955.879834:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738480768 00000100:00100000:2.0:1789672955.879837:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738480768 00000100:00100000:2.0:1789672955.879855:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789672955.879862:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+22:3637:x1876607738481152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789672955.879875:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672955.879890:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc52434000/0x6c78c4f8c9964b6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c9964b63 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.879902:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672955.879936:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+21:3637:x1876607738481152:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672955.879955:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789672955.879971:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789672955.879976:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+20:3637:x1876607738480768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789672955.879984:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789672955.879993:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8cd000/0x6c78c4f8c99650aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c99650a3 expref: 20 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672955.880001:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789672955.880022:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7+19:3637:x1876607738480768:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672955.880028:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789672955.881636:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738480768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789672955.881650:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738481152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789672955.881777:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672955.881784:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672955.881786:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672955.881788:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672955.881852:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738481280:0@lo:39:umount.0 00000100:00100000:1.0:1789672955.881901:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672955.881985:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738481280 00000100:00100000:2.0:1789672955.881993:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738481280 00000100:00100000:2.0:1789672955.882043:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789672955.882051:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1876607738481280:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789672955.882091:0:6517:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964d46 00000100:00080000:2.0:1789672955.882100:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8cfc7c7e3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789672955.882123:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1789672955.882267:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3634:x1876607738481280:12345-0@lo:39:umount.0 Request processed in 216us (365us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789672955.882275:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00010000:00010000:2.0:1789672955.882294:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789672955.882312:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc816a0000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789672955.882325:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738481280:0@lo:39:umount.0 00000100:00080000:3.0:1789672955.882633:0:15150:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789672955.882638:0:15150:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1789672955.882794:0:15150:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789672955.882857:0:15150:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789672955.882875:0:15150:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f514800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789672955.882897:0:15150:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789672955.882899:0:15150:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1789672955.882910:0:15150:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789672955.882982:0:15150:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789672955.882992:0:15150:0:(import.c:65:import_set_state_nolock()) ffff8cfb4693b000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789672955.883020:0:15150:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8cfc499c99c0) has no exports 00000100:00100000:1.0:1789672955.883614:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738481408:0@lo:9:umount.0 00000100:00100000:1.0:1789672955.883692:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672955.883728:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738481536:0@lo:9:umount.0 00000100:00100000:1.0:1789672955.883749:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672955.883828:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738481408 00000100:00100000:3.0:1789672955.883834:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738481408 00000100:00100000:3.0:1789672955.883876:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738481536 00000100:00100000:3.0:1789672955.883879:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738481536 00000100:00100000:3.0:1789672955.883902:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789672955.883909:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1876607738481408:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789672955.883931:0:8428:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964e96 00000100:00080000:3.0:1789672955.883939:0:8428:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f516000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789672955.883972:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789672955.884094:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3634:x1876607738481408:12345-0@lo:9:umount.0 Request processed in 185us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672955.884102:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789672955.884116:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789672955.884122:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1876607738481536:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789672955.884133:0:8428:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964fd8 00000100:00080000:3.0:1789672955.884139:0:8428:0:(import.c:65:import_set_state_nolock()) ffff8cfb45b38000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789672955.884161:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789672955.884320:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3634:x1876607738481536:12345-0@lo:9:umount.0 Request processed in 197us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672955.884335:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789672955.884370:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f514800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1789672955.884421:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672955.884426:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789672955.884633:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000001:00100000:1.0:1789672955.885373:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789672955.885379:0:6490:0:(genops.c:885:class_export_put()) final put ffff8cfc81477000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789672955.885392:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 33c1cd4d-7765-4bf5-8421-437f0a05573b 00000001:00080000:1.0:1789672955.885399:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1789672955.885402:0:6490:0:(genops.c:885:class_export_put()) final put ffff8cfc7f57e000/33c1cd4d-7765-4bf5-8421-437f0a05573b 00000001:00100000:1.0:1789672955.885409:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000001:00080000:1.0:1789672955.885413:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1789672955.885424:0:6490:0:(genops.c:885:class_export_put()) final put ffff8cfb4693f800/ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000020:00000080:2.0:1789672955.885475:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc81477000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789672955.885529:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7f57e000/33c1cd4d-7765-4bf5-8421-437f0a05573b for lustre-MDT0000 00000020:00000080:2.0:1789672955.885551:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb4693f800/ad795a16-0aa4-4e04-82a0-6f12aab5f2ea for lustre-MDT0000 00000020:00000080:2.0:1789672955.885576:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc81474000 for lustre-MDT0000 00000020:00000080:2.0:1789672955.885582:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc7f57b800 for lustre-MDT0000 00000020:00000080:2.0:1789672955.885586:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc7f578000 for lustre-MDT0000 00000004:00080000:3.0:1789672955.885747:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789672955.885754:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738481408:0@lo:9:umount.0 00000100:00080000:3.0:1789672955.885776:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb4693b000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789672955.885845:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789672955.885967:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789672955.885972:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738481536:0@lo:9:umount.0 00000020:00080000:3.0:1789672955.889539:0:15150:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8cfc499c99c0) has no exports 00000020:00000080:3.0:1789672955.937253:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964bbe 00000020:00000080:3.0:1789672955.937505:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc67ed9800/lustre-QMT0000_UUID 00000020:01000000:3.0:1789672955.937528:0:15150:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789672955.937684:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789672955.937696:0:15150:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789672955.937701:0:15150:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8cfc74593380) has no exports 00000020:00000080:1.0:1789672955.938066:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc67ed9800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789672955.938121:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964bb7 00000020:00000080:2.0:1789672955.938127:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc462e4000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789672955.938187:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789672955.938193:0:15150:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789672955.938195:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc462e0000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789672955.938197:0:15150:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc462e0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789672955.938203:0:15150:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1789672955.938391:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc462e4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789672955.938438:0:15150:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfc49cf3180 - data ffff8cfb45c3c870/ffff8cfb47926400 00000020:01000000:2.0:1789672955.938536:0:15150:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfc5cf7d360 - data ffff8cfc78570798/ffff8cfc7c3d6800 00000001:00000004:2.0:1789672955.949994:0:15150:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1789672955.992869:0:15150:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789672955.992880:0:15150:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789672955.992895:0:15150:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8cfc7f648700 x1876607738481280/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789672965 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672955.992922:0:15150:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789672955.994704:0:15150:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789672955.994709:0:15150:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1789672955.994731:0:15150:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789672955.994732:0:15150:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789672955.995727:0:8492:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789672955.995732:0:8492:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1789672955.995745:0:8492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789672955.996968:0:15150:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789672955.996975:0:15150:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1789672955.996996:0:15150:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789672955.997008:0:15150:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789672955.998021:0:9981:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789672955.998032:0:9981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1789672955.998047:0:9981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789672956.000534:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964b86 00000020:00000080:0.0:1789672956.000547:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc499da800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789672956.000605:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc499da800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789672956.002400:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964b9b 00000020:00000080:0.0:1789672956.002413:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc4420d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789672956.002426:0:15150:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789672956.002431:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789672956.002440:0:15150:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789672956.002445:0:15150:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8cfc499c8000) has no exports 00000004:01000000:0.0:1789672956.002610:0:15150:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789672956.002619:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964fd1 00000020:00000080:0.0:1789672956.002624:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfb4693e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789672956.002628:0:15150:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789672956.002631:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789672956.002640:0:15150:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789672956.002642:0:15150:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff8cfb46770000) has no exports 00000020:00000080:0.0:1789672956.002649:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964fca 00000020:00000080:0.0:1789672956.002652:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfb46938000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1789672956.003176:0:15150:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789672956.003181:0:15150:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789672956.003186:0:15150:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1789672956.003192:0:15150:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789672956.003194:0:15150:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789672956.003281:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789672956.003289:0:15150:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789672956.003293:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964e8f 00000020:00000080:0.0:1789672956.003298:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfb46769000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789672956.003301:0:15150:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789672956.003305:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789672956.003309:0:15150:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789672956.003312:0:15150:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8cfb466199c0) has no exports 00000020:00000080:0.0:1789672956.003316:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964e88 00000020:00000080:0.0:1789672956.003319:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc7f512800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1789672956.003895:0:15150:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789672956.003900:0:15150:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789672956.003902:0:15150:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1789672956.003906:0:15150:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789672956.003907:0:15150:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789672956.003932:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789672956.003938:0:15150:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1789672956.003949:0:15150:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789672956.003954:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964d3f 00000020:00000080:0.0:1789672956.003960:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc81799800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789672956.003965:0:15150:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1789672956.003969:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789672956.003974:0:15150:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789672956.003977:0:15150:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8cfc67f08000) has no exports 00000020:00000080:0.0:1789672956.003981:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964d38 00000020:00000080:0.0:1789672956.003984:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc816a0800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789672956.004751:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc4420d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1789672956.004761:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb4693e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789672956.004768:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb46938000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789672956.004775:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb4693b000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789672956.004781:0:37:0:(genops.c:885:class_export_put()) final put ffff8cfb4693b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789672956.004783:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb4693b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789672956.004788:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789672956.004875:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb46769000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789672956.004880:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7f512800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789672956.004884:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc7f514800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789672956.004889:0:37:0:(genops.c:885:class_export_put()) final put ffff8cfc7f515000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789672956.004899:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7f515000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789672956.004904:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789672956.004937:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc81799800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789672956.004942:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc816a0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789672956.006137:0:15150:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1789672956.006144:0:15150:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789672956.006148:0:15150:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1789672956.006156:0:15150:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789672956.006202:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789672956.006222:0:15150:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789672956.006248:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789672956.006252:0:15150:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789672956.006256:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc74434800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789672956.006259:0:15150:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc74434800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789672956.006264:0:15150:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789672956.006346:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964ba2 00000020:00000080:1.0:1789672956.006353:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc44209000/lustre-MDD0000_UUID 00000020:01000000:1.0:1789672956.006357:0:15150:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789672956.006360:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789672956.006365:0:15150:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789672956.006368:0:15150:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8cfc44200000) has no exports 00000020:00000080:1.0:1789672956.006387:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789672956.006390:0:15150:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789672956.006394:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964ba9 00000020:00000080:1.0:1789672956.006397:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc4420e800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789672956.006406:0:15150:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfc44f3d800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789672956.006409:0:15150:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfc44f3d800 3 00000020:01000004:1.0:1789672956.006412:0:15150:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cfc44f3d800 from lustre-MDT0000 00000020:00000080:1.0:1789672956.006430:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789672956.006434:0:15150:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789672956.006448:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc499dc800/lustre-MDT0000_UUID 00000020:00000080:1.0:1789672956.006450:0:15150:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc499dc800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789672956.006458:0:15150:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789672956.006488:0:15150:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1789672956.006493:0:15150:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789672956.006496:0:15150:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789672956.006499:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789672956.006502:0:15150:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789672956.006508:0:15150:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8cfc5f926800 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789672956.006513:0:15150:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8cfc745919c0) has exports, disconnecting them 00000020:00080000:1.0:1789672956.006518:0:15150:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8cfc5f926800), last request at 1789672688 00000020:00000080:1.0:1789672956.006534:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964b40 00000020:00010000:1.0:1789672956.006538:0:15150:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cfc5f926800: total 2 00000100:00080000:1.0:1789672956.006542:0:15150:0:(import.c:65:import_set_state_nolock()) ffff8cfc5f926000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789672956.006561:0:15150:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfc5f926800): rc 0 00000020:00080000:1.0:1789672956.006565:0:15150:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8cfc745919c0) has no exports 00000020:00000080:3.0:1789672956.006754:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc816a0000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789672956.006763:0:37:0:(genops.c:885:class_export_put()) final put ffff8cfc816a1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789672956.006765:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc816a1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1789672956.006769:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789672956.006825:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc44209000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789672956.006829:0:37:0:(genops.c:885:class_export_put()) final put ffff8cfc4420c000/lustre-MDD0000_UUID 00000020:00000080:3.0:1789672956.006831:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc4420c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789672956.006833:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789672956.006859:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc4420e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1789672956.006962:0:6500:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cfc5f926800: total 0 00010000:00010000:2.0:1789672956.007005:0:6500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cfc5f926800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789672956.007040:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d887400/0x6c78c4f8c9965048 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c9965041 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672956.007057:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8a1200/0x6c78c4f8c9964f68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c9964f61 expref: 13 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672956.007097:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c99650b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c99650b1 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672956.007176:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8a1c00/0x6c78c4f8c9965056 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c996504f expref: 11 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672956.007190:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d887000/0x6c78c4f8c9965064 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c996505d expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672956.007199:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8a1600/0x6c78c4f8c9965072 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c996506b expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672956.007478:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc61608600/0x6c78c4f8c9965080 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c9965079 expref: 8 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672956.007491:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c99652fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c99652f6 expref: 7 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672956.007502:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc5132b400/0x6c78c4f8c9964c43 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c9964c3c expref: 6 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672956.007515:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc427c3600/0x6c78c4f8c9964c51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c9964c4a expref: 5 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672956.007526:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d887c00/0x6c78c4f8c99652da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c99652d3 expref: 4 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672956.007536:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c99652e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c99652e1 expref: 3 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672956.007561:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc61609800/0x6c78c4f8c996508e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6c78c4f8c9965087 expref: 2 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672956.007571:0:6500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cfc5f926800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1789672956.007588:0:6500:0:(genops.c:885:class_export_put()) final put ffff8cfc5f926800/79ca85f0-2dcd-4ff4-bdad-0cbec506eae7 00010000:00010000:2.0:1789672956.007637:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672956.007640:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672956.007642:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672956.007736:0:6506:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8cfc43e4e600:6506] 1 exiting: rc = 0 00000020:00000080:3.0:1789672956.008084:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc5f926800/79ca85f0-2dcd-4ff4-bdad-0cbec506eae7 for MGS 00000020:00000080:3.0:1789672956.008124:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc5f926000 for MGS 00000100:00100000:1.0:1789672956.009614:0:6504:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8cfc44802000:6504] 0 exiting: rc = 1 00000100:00100000:1.0:1789672956.010811:0:6507:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8cfc43138000:6507] 2 exiting: rc = 0 00000100:00100000:3.0:1789672956.010986:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011004:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011010:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011017:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011022:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011028:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011033:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011039:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011044:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011050:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011056:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011063:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011090:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011097:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011103:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011402:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011412:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011418:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011424:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011429:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011434:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011440:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011446:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011453:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011458:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011463:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011469:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011475:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011481:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011487:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011492:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011497:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011503:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011508:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011513:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011533:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011547:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011552:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011557:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011563:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011568:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011574:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011591:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011597:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011603:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011608:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011613:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011618:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011623:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011628:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011632:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011637:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011641:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011649:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011653:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011692:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011698:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011703:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011708:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011713:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011718:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011723:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011729:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672956.011734:0:15150:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1789672956.012851:0:15150:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfc49cf3c00 - data ffff8cfb45c3ce58/ffff8cfb47927400 00000020:01000000:3.0:1789672956.012970:0:15150:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfc43e5dae0 - data ffff8cfc784a5000/ffff8cfc72cb0800 00000020:00000080:3.0:1789672956.013524:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964b2b 00000020:00000080:3.0:1789672956.013533:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc65c39000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789672956.013591:0:15150:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfc44f3d800 from MGS, refs=2 00000020:01000004:3.0:1789672956.013594:0:15150:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfc44f3d800 2 00000020:01000004:3.0:1789672956.013605:0:15150:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cfc44f3d800 from MGS 00000020:00000080:3.0:1789672956.013626:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789672956.013632:0:15150:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789672956.013634:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc73205000/MGS 00000020:00000080:3.0:1789672956.013637:0:15150:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc73205000/MGS for MGS 00000020:01000000:3.0:1789672956.013644:0:15150:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789672956.013724:0:15150:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789672956.013729:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789672956.013735:0:15150:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789672956.013741:0:15150:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8cfc575f9000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789672956.013747:0:15150:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8cfc67f0cd40) has exports, disconnecting them 00000020:00080000:3.0:1789672956.013751:0:15150:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8cfc575f9000), last request at 1789672689 00000020:00000080:3.0:1789672956.013756:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964bf6 00000020:00080000:3.0:1789672956.013764:0:15150:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfc575f9000): rc 0 00000020:00000080:3.0:1789672956.013769:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc575f9000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789672956.014461:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc65c39000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789672956.015294:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc575f9000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789672956.048776:0:15150:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789672956.048786:0:15150:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789672956.048790:0:15150:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789672956.048798:0:15150:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789672956.048966:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789672956.048976:0:15150:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789672956.048984:0:15150:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfc44f3d800 1 00000020:00000080:0.0:1789672956.048991:0:15150:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964b1d 00000020:00000080:0.0:1789672956.049000:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc73206000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789672956.049006:0:15150:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789672956.049010:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789672956.049026:0:15150:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789672956.049030:0:15150:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8cfc74590000) has no exports 00000020:00000080:1.0:1789672956.049397:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc462e2800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789672956.049405:0:8:0:(genops.c:885:class_export_put()) final put ffff8cfc575fb800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789672956.049408:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc575fb800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789672956.049417:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789672956.049489:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc73206000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1789672956.100990:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789672956.139461:0:15150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789672956.139474:0:15150:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789672956.139479:0:15150:0:(genops.c:885:class_export_put()) final put ffff8cfc6a31c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789672956.139494:0:15150:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc6a31c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789672956.139506:0:15150:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789672956.139943:0:15150:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cfc44f3e800 00000020:02000400:0.0:1789672956.140005:0:15150:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789672957.123828:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789672957.263700:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789672957.263711:0:9507:0:(genops.c:885:class_export_put()) final put ffff8cfb45b3a800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789672957.263739:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000020:00000080:2.0:1789672957.263742:0:9507:0:(genops.c:885:class_export_put()) final put ffff8cfb46bf5000/ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000020:00000080:1.0:1789672957.264208:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb45b3a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789672957.264264:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb46bf5000/ad795a16-0aa4-4e04-82a0-6f12aab5f2ea for lustre-OST0001 00000020:00000080:1.0:1789672957.264283:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb45b38000 for lustre-OST0001 00000020:00000080:1.0:1789672957.264288:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb47a6d800 for lustre-OST0001 00000001:00100000:2.0:1789672957.266508:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789672957.266516:0:8423:0:(genops.c:885:class_export_put()) final put ffff8cfc7f510800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789672957.266543:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000020:00000080:2.0:1789672957.266546:0:8423:0:(genops.c:885:class_export_put()) final put ffff8cfb48119800/ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000020:00000080:2.0:1789672957.266713:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7f510800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789672957.266750:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb48119800/ad795a16-0aa4-4e04-82a0-6f12aab5f2ea for lustre-OST0000 00000020:00000080:2.0:1789672957.266782:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc7f516000 for lustre-OST0000 00000020:00000080:2.0:1789672957.266786:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb4811d800 for lustre-OST0000 00000001:00100000:3.0:1789672957.267455:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789672957.267467:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1789672957.267470:0:7443:0:(genops.c:885:class_export_put()) final put ffff8cfc7c7e2000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789672957.267522:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 33c1cd4d-7765-4bf5-8421-437f0a05573b 00000001:00080000:3.0:1789672957.267527:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1789672957.267529:0:7443:0:(genops.c:885:class_export_put()) final put ffff8cfc7f57e800/33c1cd4d-7765-4bf5-8421-437f0a05573b 00000020:00000080:1.0:1789672957.272317:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c7e2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1789672957.272398:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc7c7e3800 for lustre-MDT0001 00000020:00000080:1.0:1789672957.283875:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7f57e800/33c1cd4d-7765-4bf5-8421-437f0a05573b for lustre-MDT0001 00000020:00000080:1.0:1789672957.283952:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc7f57c000 for lustre-MDT0001 00000001:00100000:3.0:1789672957.284102:0:7443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000001:00080000:3.0:1789672957.284111:0:7443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1789672957.284115:0:7443:0:(genops.c:885:class_export_put()) final put ffff8cfc7f57b000/ad795a16-0aa4-4e04-82a0-6f12aab5f2ea 00000020:00000080:2.0:1789672957.288921:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7f57b000/ad795a16-0aa4-4e04-82a0-6f12aab5f2ea for lustre-MDT0001 00000020:00000080:2.0:1789672957.289008:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc7f57c800 for lustre-MDT0001 00000100:00100000:0.0:1789672957.774705:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738481664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789672957.774780:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672957.774909:0:7834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738481664 00000100:00100000:2.0:1789672957.774918:0:7834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738481664 00000100:00100000:2.0:1789672957.774965:0:7834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789672957.774985:0:7834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1876607738481664:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1789672957.774993:0:7834:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789672957.775048:0:7834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1876607738481664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (256us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789672957.775054:0:7834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:02020000:2.0:1789672957.775095:0:3638:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1789672957.781126:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789672957.781135:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8cfc81472000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789672957.781140:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789672957.793530:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8cfc81472000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789672957.793544:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 189 00000100:00080000:2.0:1789672957.793560:0:3638:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8cfc81472000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789672957.799503:0:3638:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc462dc700 x1876607738481792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789672957.799613:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738481792:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789672957.799713:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672957.800789:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738481792 00000100:00100000:0.0:1789672957.800798:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738481792 00000100:00100000:0.0:1789672957.800839:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789672957.800846:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1876607738481792:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1789672957.800867:0:6518:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789672957.800917:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1876607738481792:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 70us (1204us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789672957.800923:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:0.0:1789672957.800961:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc81472000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789672957.800966:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789672957.800969:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738481792:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1789672958.147838:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672959.207434:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789672959.299979:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789672959.299986:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789672959.299990:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfc81472000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789672959.299998:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 435 00000100:00080000:2.0:1789672959.300004:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1789672959.300017:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738481920:0@lo:400:kworker.0 00000100:00080000:2.0:1789672959.300022:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8cfc81472000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789672959.300042:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfb48074e00 x1876607738482048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1789672959.300067:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876607738481920 offset 0 length 224: 4 00000100:00100000:1.0:1789672959.300120:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738482560:0@lo:400:kworker.0 00000100:00100000:2.0:1789672959.300127:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738482048:0@lo:38:kworker.0 00000100:00100000:2.0:1789672959.300155:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672959.300162:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672959.300180:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789672959.300186:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738482176:0@lo:400:kworker.0 00000100:00100000:2.0:1789672959.300191:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738482432:0@lo:400:kworker.0 00000100:00100000:1.0:1789672959.300209:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672959.300219:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738482048 00000100:00100000:1.0:1789672959.300228:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738482688:0@lo:400:kworker.0 00000100:00100000:2.0:1789672959.300238:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738482048 00000100:00100000:1.0:1789672959.300245:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672959.300268:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738482560 00000100:00100000:2.0:1789672959.300271:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789672959.300271:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738482560 00000100:00100000:2.0:1789672959.300277:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876607738482048:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789672959.300295:0:6517:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789672959.300309:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789672959.300315:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738482560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672959.300333:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876607738482048:12345-0@lo:38:kworker.0 Request processed in 55us (178us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789672959.300340:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789672959.300350:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738482560:12345-0@lo:400:kworker.0 Request processed in 36us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789672959.300355:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789672959.300361:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738482176 00000100:00100000:2.0:1789672959.300365:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738482176 00000100:00100000:1.0:1789672959.300371:0:9524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738482688 00000100:00100000:1.0:1789672959.300373:0:9524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738482688 00000100:00100000:1.0:1789672959.300391:0:9524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789672959.300396:0:9524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1876607738482176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672959.300398:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789672959.300402:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1876607738482688:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789672959.300408:0:6513:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000020:00080000:1.0:1789672959.300408:0:9524:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789672959.300431:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3635:x1876607738482688:12345-0@lo:400:kworker.0 Request processed in 27us (183us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789672959.300431:0:9524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1876607738482176:12345-0@lo:400:kworker.0 Request processed in 33us (220us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789672959.300437:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789672959.300505:0:9524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789672959.300506:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738482304:0@lo:400:kworker.0 00000100:00100000:3.0:1789672959.300533:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789672959.300535:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738483072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789672959.300560:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738482816:0@lo:400:kworker.0 00000100:00100000:1.0:1789672959.300561:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789672959.300589:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789672959.300594:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8cfc7c7e2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789672959.300597:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1789672959.301578:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789672959.301625:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789672959.301638:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738482304 00000100:00100000:3.0:1789672959.301643:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738482304 00000100:00100000:3.0:1789672959.301686:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738482816 00000100:00100000:3.0:1789672959.301690:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738482816 00000100:00100000:3.0:1789672959.301803:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789672959.301813:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738482816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789672959.301860:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738482816:12345-0@lo:400:kworker.0 Request processed in 51us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672959.301866:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789672959.301880:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789672959.301883:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1876607738482304:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789672959.301888:0:6514:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789672959.301908:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1876607738482304:12345-0@lo:400:kworker.0 Request processed in 23us (1375us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789672959.301913:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:3.0:1789672959.301929:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789672959.301958:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789672959.301962:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8cfc462e3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789672959.301965:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789672959.301970:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8cfc462e3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789672959.301973:0:3637:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 212 00000100:00080000:3.0:1789672959.301980:0:3637:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cfc462e3000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789672959.301999:0:3637:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7f648e00 x1876607738483200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789672959.302041:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738482304:0@lo:400:kworker.0 00010000:00080000:3.0:1789672959.302055:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8cfb48076680 x1876607738482816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789672959.302065:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738482816:0@lo:400:kworker.0 00000100:00100000:2.0:1789672959.302866:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876607738483200:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789672959.302910:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789672959.302936:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc81472000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789672959.302941:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789672959.303188:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738483200 00000100:00100000:3.0:1789672959.303194:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738483200 00000100:00100000:3.0:1789672959.303222:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789672959.303227:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1876607738483200:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1789672959.303245:0:6514:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789672959.303277:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1876607738483200:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 49us (367us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789672959.303283:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789672959.303328:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738482048:0@lo:38:kworker.0 00000100:00080000:2.0:1789672959.303350:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc462e3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789672959.303354:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789672959.303357:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876607738483200:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789672959.303773:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672959.303815:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb48075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738482944:0@lo:400:kworker.0 00000100:00100000:0.0:1789672959.303847:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672959.304208:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738482944 00000100:00100000:2.0:1789672959.304214:0:8428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738482944 00000100:00100000:2.0:1789672959.304263:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789672959.304282:0:8428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738482944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789672959.304330:0:8428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738482944:12345-0@lo:400:kworker.0 Request processed in 49us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672959.304336:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789672959.304367:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738482944:0@lo:400:kworker.0 00000100:00100000:3.0:1789672959.304476:0:11081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738482432 00000100:00100000:3.0:1789672959.304480:0:11081:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738482432 00000100:00100000:3.0:1789672959.304512:0:11081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1789672959.304519:0:11081:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738482432:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789672959.304991:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789672959.304995:0:6508:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789672959.312025:0:11081:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738482432:12345-0@lo:400:kworker.0 Request processed in 7484us (8230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672959.312042:0:11081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00010000:00080000:2.0:1789672959.316350:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8cfb48077480 x1876607738482432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789672959.316370:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738482432:0@lo:400:kworker.0 00000100:00100000:2.0:1789672959.319752:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738483072 00000100:00100000:2.0:1789672959.319770:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738483072 00000100:00100000:2.0:1789672959.320122:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789672959.320134:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738483072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789672959.320170:0:8432:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789672959.320258:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738483072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (19695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789672959.320265:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1789672959.322237:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8cfc7c7e2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789672959.322249:0:3635:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 189 00000100:00080000:1.0:1789672959.322268:0:3635:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8cfc7c7e2800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789672959.322307:0:3635:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d8de680 x1876607738483328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789672959.322380:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876607738483328:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789672959.322444:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789672959.322526:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738483328 00000100:00100000:0.0:1789672959.322533:0:6513:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738483328 00000100:00100000:0.0:1789672959.322572:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789672959.322592:0:6513:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1876607738483328:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1789672959.322612:0:6513:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789672959.322679:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738482176:0@lo:400:kworker.0 00000100:00080000:1.0:1789672959.322703:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789672959.322706:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8cfb4769a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789672959.322709:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789672959.322712:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8cfb4769a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789672959.322715:0:3635:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 238 00000100:00080000:1.0:1789672959.322720:0:3635:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cfb4769a800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789672959.322735:0:3635:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d8dc000 x1876607738483456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789672959.328773:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876607738483456:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789672959.328854:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789672959.328977:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738483456 00000100:00100000:2.0:1789672959.328986:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738483456 00000100:00100000:2.0:1789672959.329042:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789672959.329051:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876607738483456:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1789672959.329075:0:6512:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789672959.329119:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876607738483456:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 68us (264us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789672959.329126:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789672959.329518:0:6513:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1876607738483328:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 6924us (7072us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789672959.329526:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789672959.330245:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738482688:0@lo:400:kworker.0 00000100:00100000:1.0:1789672959.330277:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738482560:0@lo:400:kworker.0 00000100:00100000:1.0:1789672959.330324:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738483072:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789672959.336233:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc7c7e2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789672959.336247:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789672959.336252:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876607738483328:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1789672959.336376:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb4769a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789672959.336396:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789672959.336400:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876607738483456:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1789672960.199532:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789672960.770522:0:15350:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789672960.785458:0:15350:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1789672960.785577:0:15350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965080 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.785595:0:15350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9965080 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.785604:0:15350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9965080 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.785903:0:15350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9965080 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.785972:0:15350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789672960.785978:0:15350:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789672960.786017:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789672960.786022:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789672960.786028:0:15350:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789672960.786034:0:15350:0:(import.c:65:import_set_state_nolock()) ffff8cfc7c7e2800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789672960.786039:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789672960.786041:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789672960.786044:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789672960.787939:0:15350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996508e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.787969:0:15350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996508e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.787977:0:15350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c996508e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.787994:0:15350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c996508e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672960.788152:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789672960.788222:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9965080 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672960.788229:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886400 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:3.0:1789672960.788233:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9965080 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672960.788241:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c9965080 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672960.788248:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c9965080 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672960.788253:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789672960.788255:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789672960.788258:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789672960.788304:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c9965080 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672960.788311:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789672960.788375:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738483584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672960.788444:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789672960.788515:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c9965080 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672960.788522:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886400/0x6c78c4f8c9965079 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c9965080 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672960.788537:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789672960.788546:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c996508e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672960.788552:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0200 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:3.0:1789672960.788555:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c996508e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672960.788561:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c996508e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789672960.788567:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c996508e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789672960.788572:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789672960.788574:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1789672960.788587:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c996508e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672960.788593:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789672960.788621:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c996508e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789672960.788629:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672960.788631:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672960.788633:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789672960.788654:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738483712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789672960.788701:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672960.788746:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738483584 00000100:00100000:3.0:1789672960.788753:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738483584 00000100:00100000:3.0:1789672960.788785:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738483712 00000100:00100000:3.0:1789672960.788789:0:6497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738483712 00000100:00100000:3.0:1789672960.788815:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789672960.788822:0:6497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f715f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3636:x1876607738483584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789672960.788827:0:6497:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789672960 with bad export cookie 7816213726114499392 00000100:00100000:0.0:1789672960.789311:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789672960.789319:0:6496:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc5f86a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3637:x1876607738483712:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789672960.789324:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789672960 with bad export cookie 7816213726114499392 00000100:00100000:0.0:1789672960.789372:0:6496:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc5f86a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3637:x1876607738483712:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (670us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789672960.789379:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789672960.790296:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789672960.790301:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8cfc499da000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789672960.790305:0:3637:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.150@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1789672960.792873:0:15350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789672960.792887:0:15350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0200/0x6c78c4f8c9965087 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c996508e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.792910:0:15350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964f68 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.792918:0:15350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964f68 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.792925:0:15350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9964f68 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.792933:0:15350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9964f68 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.792962:0:15350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789672960.792970:0:15350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99652fd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.793009:0:15350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99652fd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.793016:0:15350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c99652fd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.793022:0:15350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c99652fd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.793038:0:15350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789672960.793043:0:15350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52435c00/0x6c78c4f8c9964c4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9964c51 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.793049:0:15350:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52435c00/0x6c78c4f8c9964c4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9964c51 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.793055:0:15350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52435c00/0x6c78c4f8c9964c4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9964c51 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.793060:0:15350:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc52435c00/0x6c78c4f8c9964c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9964c51 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.793068:0:15350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1789672960.793072:0:15350:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1789672960.793076:0:15350:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1789672960.793115:0:15350:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1789672960.793119:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1789672960.793124:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789672960.793129:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1789672960.793141:0:15350:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8cfb46bf6000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789672960.793146:0:15350:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8cfc81a20800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789672960.793151:0:15350:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8cfc44203380) has exports, disconnecting them 00000020:00080000:1.0:1789672960.794504:0:15350:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8cfb46bf6000), last request at 1789672959 00000020:00000080:1.0:1789672960.794513:0:15350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964f29 00000100:00080000:1.0:1789672960.794532:0:15350:0:(import.c:65:import_set_state_nolock()) ffff8cfb419e7800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789672960.794589:0:15350:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfb46bf6000): rc 0 00000020:00000080:1.0:1789672960.794592:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfb46bf6000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1789672960.794606:0:15350:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8cfc81a20800), last request at 1789672959 00000020:00000080:1.0:1789672960.794619:0:15350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964e03 00000100:00080000:1.0:1789672960.794627:0:15350:0:(import.c:65:import_set_state_nolock()) ffff8cfc81a26000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789672960.794634:0:15350:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfc81a20800): rc 0 00000020:00000080:1.0:1789672960.794636:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfc81a20800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1789672960.794644:0:15350:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffac6d8183bae0 00000100:00080000:1.0:1789672960.794684:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789672960.794694:0:15350:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8cfb48074000 x1876607738481664/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789672973 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672960.794711:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1789672960.795483:0:15350:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789672960.795490:0:15350:0:(import.c:65:import_set_state_nolock()) ffff8cfc81472000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:1.0:1789672960.797291:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb46bf6000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1789672960.797370:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc81a20800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1789672960.797393:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb419e7800 for lustre-MDT0001 00000020:00000080:1.0:1789672960.797398:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc81a26000 for lustre-MDT0001 00010000:00010000:2.0:1789672960.797522:0:13186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789672960.797531:0:13186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9964f68 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672960.797542:0:13186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61608400 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:2.0:1789672960.797547:0:13186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9964f68 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672960.797557:0:13186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c9964f68 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672960.797565:0:13186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c9964f68 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672960.797571:0:13186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789672960.797573:0:13186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789672960.797577:0:13186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00080000:1.0:1789672960.801532:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789672960.801539:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1789672960.801553:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789672960.801628:0:15350:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789672960.801655:0:15350:0:(import.c:65:import_set_state_nolock()) ffff8cfb4676a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789672960.801686:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789672960.801689:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1789672960.801699:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789672960.801755:0:15350:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789672960.801763:0:15350:0:(import.c:65:import_set_state_nolock()) ffff8cfb4693f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789672960.801786:0:15350:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8cfc44203380) has no exports 00010000:00010000:1.0:1789672960.806388:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789672960.806401:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c99652fd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.806413:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61608e00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:1.0:1789672960.806417:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c99652fd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.806428:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c99652fd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789672960.806435:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c99652fd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789672960.806442:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789672960.806444:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789672960.806448:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:3.0:1789672960.809599:0:6497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f715f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3636:x1876607738483584:12345-0@lo:103:ldlm_bl.0 Request processed in 20771us (21149us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789672960.809613:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789672960.812729:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738483840:0@lo:9:umount.0 00000100:00100000:3.0:1789672960.812797:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672960.812840:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738483968:0@lo:9:umount.0 00000100:00100000:3.0:1789672960.812859:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789672960.812943:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738483840 00000100:00100000:3.0:1789672960.812951:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738483840 00000100:00100000:3.0:1789672960.813003:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738483968 00000100:00100000:3.0:1789672960.813007:0:8430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738483968 00000100:00100000:3.0:1789672960.813030:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789672960.813040:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1876607738483840:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789672960.813065:0:8430:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964e50 00000100:00080000:3.0:1789672960.813090:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8cfc81a23800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789672960.813126:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789672960.813264:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3634:x1876607738483840:12345-0@lo:9:umount.0 Request processed in 225us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672960.813272:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789672960.813285:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789672960.813292:0:8430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1876607738483968:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789672960.813302:0:8430:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964f92 00000100:00080000:3.0:1789672960.813308:0:8430:0:(import.c:65:import_set_state_nolock()) ffff8cfb468c0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789672960.813322:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789672960.813399:0:8430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3634:x1876607738483968:12345-0@lo:9:umount.0 Request processed in 108us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789672960.813406:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1789672960.813439:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb4676a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789672960.813449:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789672960.813451:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789672960.813455:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738483840:0@lo:9:umount.0 00000100:00080000:3.0:1789672960.813463:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb4693f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789672960.813471:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789672960.813473:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789672960.813475:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738483968:0@lo:9:umount.0 00000100:00080000:3.0:1789672960.813507:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789672960.822630:0:3637:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.150@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789672960.822635:0:3637:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789672960.822646:0:3637:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfb48076d80 x1876607738481920/t0(0) o400->MGC192.168.201.150@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789672975 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672960.822698:0:3637:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc7f64a300 x1876607738483584/t0(0) o103->MGC192.168.201.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789672976 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672960.822708:0:3637:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc7f64aa00 x1876607738483712/t0(0) o103->MGC192.168.201.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789672976 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789672960.822717:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789672960.822720:0:3637:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789672960.822721:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:2.0:1789672960.822797:0:13186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c9964f68 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672960.822808:0:13186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789672960.822825:0:13186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c9964f68 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672960.822852:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc61608400/0x6c78c4f8c9964f61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c9964f68 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672960.822879:0:13186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672960.822884:0:13186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc52435c00/0x6c78c4f8c9964c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9964c51 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672960.822891:0:13186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435c00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:2.0:1789672960.822895:0:13186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52435c00/0x6c78c4f8c9964c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9964c51 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672960.822905:0:13186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc52435c00/0x6c78c4f8c9964c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c9964c51 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672960.822913:0:13186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52435c00/0x6c78c4f8c9964c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c9964c51 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672960.822918:0:13186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789672960.822921:0:13186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789672960.822925:0:13186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789672960.822938:0:13186:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfc499da000 00010000:00010000:2.0:1789672960.822941:0:13186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc52435c00/0x6c78c4f8c9964c4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c78c4f8c9964c51 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672960.822947:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc52435c00/0x6c78c4f8c9964c4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c78c4f8c9964c51 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672960.822958:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672960.822960:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672960.823260:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672960.823477:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:0:1876607738484224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789672960.823495:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3635:1876607738481920:0@lo:400:kworker.0 00010000:00010000:1.0:1789672960.823610:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c99652fd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.823618:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789672960.823637:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c99652fd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.823654:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc61608e00/0x6c78c4f8c99652f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6c78c4f8c99652fd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672960.823683:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672960.823684:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672960.823686:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672960.823759:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672960.823768:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:0:1876607738484352:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789672960.824266:0:3636:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8cfc499da000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1789672960.824295:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3636:1876607738483584:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789672960.824346:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8cfc499da000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789672960.824353:0:3637:0:(import.c:545:import_select_connection()) MGC192.168.201.150@tcp: connect to NID 0@lo last attempt 166 00000100:00080000:0.0:1789672960.824375:0:3637:0:(import.c:666:import_select_connection()) MGC192.168.201.150@tcp: import ffff8cfc499da000 using connection 192.168.201.150@tcp/0@lo 00000100:00080000:0.0:1789672960.824479:0:3638:0:(client.c:1394:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff8cfc7f648000 x1876607738484096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672960.824504:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:0:1876607738484096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789672960.824512:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb48074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738481664:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789672960.824552:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672960.824575:0:3637:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc462dc000 x1876607738484480/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789672960.824632:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3634:1876607738484480:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1789672960.824755:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876607738484480 offset 0 length 520: 4 00000100:00100000:0.0:1789672960.824839:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3637:1876607738483712:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789672960.831394:0:15350:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8cfc44203380) has no exports 00000020:01000000:3.0:1789672960.903088:0:15350:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfc49cf3420 - data ffff8cfc78742ca8/ffff8cfb47926c00 00000020:01000000:3.0:1789672960.903278:0:15350:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfc5cf7d7e0 - data ffff8cfc785f5798/ffff8cfc81586800 00000001:00000004:3.0:1789672960.916816:0:15350:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1789672961.018906:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789672961.018914:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789672961.018922:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789672961.044785:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789672961.044795:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1789672961.044815:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789672961.044818:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789672961.045495:0:8485:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789672961.045501:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1789672961.045511:0:8485:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1789672961.046171:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789672961.046176:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:1.0:1789672961.046201:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789672961.046203:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789672961.047285:0:9977:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789672961.047291:0:9977:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1789672961.047300:0:9977:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789672961.049536:0:15350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964c6d 00000020:00000080:1.0:1789672961.049547:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfc7c46c800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789672961.050090:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c46c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789672961.051331:0:15350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964c82 00000020:00000080:1.0:1789672961.051341:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfc7c7e1800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789672961.051357:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1789672961.051362:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789672961.051370:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789672961.051375:0:15350:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8cfc442019c0) has no exports 00000020:00000080:0.0:1789672961.051384:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c7e1800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:1.0:1789672961.051531:0:15350:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789672961.051540:0:15350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964f8b 00000020:00000080:1.0:1789672961.051544:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfb47965800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789672961.051805:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789672961.051810:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789672961.051826:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789672961.051829:0:15350:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff8cfb46774d40) has no exports 00000020:00000080:1.0:1789672961.051834:0:15350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964f84 00000020:00000080:1.0:1789672961.051838:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfb4693c800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789672961.056631:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb47965800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1789672961.057732:0:15350:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789672961.057738:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789672961.057742:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1789672961.057749:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789672961.057751:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789672961.057792:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789672961.057806:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789672961.057812:0:15350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964e49 00000020:00000080:1.0:1789672961.057820:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfc81a22000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789672961.057825:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789672961.057832:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789672961.057837:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789672961.057841:0:15350:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff8cfb46618000) has no exports 00000020:00000080:1.0:1789672961.057847:0:15350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964e42 00000020:00000080:1.0:1789672961.057850:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfb46768800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1789672961.058343:0:15350:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789672961.058347:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789672961.058349:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1789672961.058353:0:15350:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789672961.058355:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789672961.058382:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789672961.058387:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1789672961.058400:0:15350:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789672961.058406:0:15350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964ca5 00000020:00000080:1.0:1789672961.058411:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfc7c562000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789672961.058415:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1789672961.058419:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789672961.058422:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789672961.058435:0:15350:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8cfc7c6799c0) has no exports 00000020:00000080:1.0:1789672961.058439:0:15350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964c9e 00000020:00000080:1.0:1789672961.058442:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfc7c567000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789672961.060627:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb4693c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789672961.060646:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb4693f000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789672961.060654:0:37:0:(genops.c:885:class_export_put()) final put ffff8cfb4769f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789672961.060677:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb4769f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789672961.060682:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789672961.060775:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc81a22000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789672961.060782:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb46768800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789672961.060787:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb4676a000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789672961.060792:0:37:0:(genops.c:885:class_export_put()) final put ffff8cfb4676f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789672961.060806:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb4676f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789672961.060810:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789672961.060842:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c562000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789672961.060848:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c567000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789672961.066817:0:15350:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789672961.066828:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789672961.066832:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789672961.066841:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789672961.066910:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789672961.066934:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789672961.066967:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789672961.066970:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789672961.066985:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfc7c468800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789672961.066991:0:15350:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c468800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789672961.066999:0:15350:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789672961.067200:0:15350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964c89 00000020:00000080:0.0:1789672961.067208:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfc7c7e4000/lustre-MDD0001_UUID 00000020:01000000:0.0:1789672961.067213:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789672961.067217:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789672961.067221:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789672961.067225:0:15350:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8cfc44204d40) has no exports 00000020:00000080:0.0:1789672961.067247:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789672961.067250:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789672961.067254:0:15350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964c90 00000020:00000080:0.0:1789672961.067259:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfc7c7e7000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789672961.067267:0:15350:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfc7c498000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789672961.067270:0:15350:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfc7c498000 2 00000020:01000004:0.0:1789672961.067274:0:15350:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cfc7c498000 from lustre-MDT0001 00000020:00000080:0.0:1789672961.067291:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789672961.067294:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789672961.067307:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfc7c46a800/lustre-MDT0001_UUID 00000020:00000080:0.0:1789672961.067309:0:15350:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c46a800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789672961.067316:0:15350:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789672961.067344:0:15350:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789672961.067349:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789672961.067352:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789672961.067355:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789672961.067362:0:15350:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8cfc7c567800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789672961.067367:0:15350:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8cfc815d8000) has exports, disconnecting them 00000020:00080000:0.0:1789672961.067371:0:15350:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8cfc7c567800), last request at 1789672712 00000020:00000080:0.0:1789672961.067375:0:15350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964ce4 00000020:00080000:0.0:1789672961.067387:0:15350:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfc7c567800): rc 0 00000020:00000080:0.0:1789672961.067390:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfc7c567800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789672961.068600:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc81472000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1789672961.068615:0:37:0:(genops.c:885:class_export_put()) final put ffff8cfc7c560000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789672961.068618:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c560000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1789672961.068631:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789672961.068789:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c7e4000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1789672961.068803:0:37:0:(genops.c:885:class_export_put()) final put ffff8cfc7c46f000/lustre-MDD0001_UUID 00000020:00000080:3.0:1789672961.068805:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c46f000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1789672961.068808:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1789672961.069020:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c7e7000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789672961.069025:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c567800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1789672961.218410:0:15350:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1789672961.218420:0:15350:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789672961.218424:0:15350:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789672961.218431:0:15350:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789672961.218735:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc7c7e2800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789672961.220565:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789672961.220579:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1789672961.220586:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfc7c7e6000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1789672961.220591:0:15350:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c7e6000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1789672961.220607:0:15350:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1789672961.220749:0:15350:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfc7c498000 1 00000020:00000080:0.0:1789672961.221564:0:15350:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964c20 00000020:00000080:0.0:1789672961.221574:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfc7c564000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1789672961.221646:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1789672961.221652:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789672961.221672:0:15350:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789672961.221677:0:15350:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8cfc7c678000) has no exports 00000020:00000080:3.0:1789672961.227896:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c564000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:00010000:0.0:1789672961.230640:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789672961.300902:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789672961.300918:0:15350:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1789672961.300924:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfc7c498800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789672961.300929:0:15350:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c498800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1789672961.300940:0:15350:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1789672961.301217:0:15350:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cfc7c49e000 00000020:01000000:1.0:1789672961.301239:0:15350:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789672961.301243:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789672961.301248:0:15350:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789672961.301252:0:15350:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8cfc499ccd40) has no exports 00000100:00100000:3.0:1789672961.301558:0:11081:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8cfb46baf600:11081] 4 exiting: rc = 0 00000100:00100000:2.0:1789672961.302401:0:6512:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8cfc49f77200:6512] 0 exiting: rc = 1 00000100:00100000:2.0:1789672961.302473:0:9524:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8cfb47694000:9524] 3 exiting: rc = 0 00000100:00100000:2.0:1789672961.302537:0:6514:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8cfc43cf2200:6514] 2 exiting: rc = 0 00000100:00100000:0.0:1789672961.305939:0:6513:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8cfc43e4f000:6513] 1 exiting: rc = 0 00000100:00100000:2.0:1789672961.306379:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306390:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306395:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306401:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306407:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306413:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306418:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306423:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306428:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306433:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306439:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306444:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306460:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306468:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306474:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306481:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306486:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306492:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306499:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306504:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306511:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306516:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306522:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306545:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306551:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306557:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306562:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306567:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306573:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306578:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306584:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306590:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306596:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306601:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306606:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306612:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306617:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306622:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306628:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306634:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306640:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306645:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306651:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306684:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306690:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306707:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306714:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306719:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306724:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306728:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306733:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306739:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306743:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306748:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306752:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306852:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306857:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306864:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306877:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306883:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306888:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306895:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306903:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.306909:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.315821:0:6515:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8cfc4ae35c00:6515] 0 exiting: rc = 1 00000100:00100000:2.0:1789672961.317773:0:6516:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8cfc49900c00:6516] 1 exiting: rc = 0 00000100:00100000:1.0:1789672961.318564:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318572:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318580:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318586:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318592:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318598:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318604:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318610:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318615:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318620:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318624:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318629:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318633:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318637:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318642:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318645:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318649:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318652:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318677:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318682:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318699:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318703:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318706:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318710:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318713:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318716:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318720:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318723:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318726:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318729:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318732:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318735:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318738:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318741:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318744:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318747:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318750:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318829:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318836:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318842:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318846:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318851:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318856:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318861:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318866:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318872:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318876:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318881:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318886:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318891:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318896:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318901:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318906:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318912:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318917:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318931:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318936:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318941:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318947:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318952:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318956:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318961:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318965:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.318983:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672961.319686:0:6517:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8cfc49f4ca00:6517] 0 exiting: rc = 1 00000100:00100000:1.0:1789672961.323786:0:6518:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8cfc49f4d000:6518] 1 exiting: rc = 0 00000100:00100000:3.0:1789672961.329393:0:7834:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8cfc7c4d3e00:7834] 2 exiting: rc = 0 00000100:00100000:0.0:1789672961.331325:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331338:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331347:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331353:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331359:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331365:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331389:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331397:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331405:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331411:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331417:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331423:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331429:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331435:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331445:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331451:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331459:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331468:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331493:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331500:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331506:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331512:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331519:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331525:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331532:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331537:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331545:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331551:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331558:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331565:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331588:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331596:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331603:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331609:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331627:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331633:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331640:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331647:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331653:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331680:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331686:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331692:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331712:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331720:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331726:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331732:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331738:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331743:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.331749:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.332143:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.332220:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.332226:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.332233:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.332240:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.332263:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.332270:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.332278:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.332284:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.332291:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.332299:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.332306:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.332312:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.332318:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.332332:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.342134:0:6520:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8cfc49901200:6520] 1 exiting: rc = 0 00000100:00100000:1.0:1789672961.342907:0:6519:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8cfc49900000:6519] 0 exiting: rc = 1 00000100:00100000:2.0:1789672961.343672:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343681:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343686:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343691:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343697:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343702:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343707:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343712:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343716:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343721:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343727:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343731:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343737:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343742:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343747:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343752:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343768:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343773:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343778:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343783:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343789:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343795:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343800:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343805:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343810:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343815:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343819:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343838:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343842:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343847:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343852:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343857:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343862:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343868:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343876:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343881:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343886:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343891:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343896:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343902:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343908:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343913:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343918:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343923:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343928:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343933:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343938:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343944:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343949:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343954:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343960:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343965:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343983:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343988:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343994:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.343999:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.344004:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.344008:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.344014:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.344018:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.344023:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.344028:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.344040:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.344045:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.344428:0:6522:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8cfc49900800:6522] 1 exiting: rc = 0 00000100:00100000:1.0:1789672961.344924:0:6521:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8cfc49901600:6521] 0 exiting: rc = 1 00000100:00100000:2.0:1789672961.345386:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345393:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345398:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345403:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345408:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345413:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345418:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345423:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345428:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345434:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345439:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345443:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345448:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345453:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345458:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345463:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345468:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345474:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345479:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345485:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345490:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345495:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345501:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345506:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345511:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345516:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345522:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345527:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345532:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345538:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345543:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345548:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345565:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345571:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345577:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345583:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345587:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345593:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345598:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345602:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345607:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345612:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345617:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345623:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345628:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345633:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345637:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345643:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345647:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.345652:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.346034:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.346043:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.346049:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.346055:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.346060:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.346243:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.346252:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.346256:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.346261:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.346265:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.346270:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.346274:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.346278:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.346282:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672961.346877:0:6524:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8cfc49f4ce00:6524] 1 exiting: rc = 0 00000100:00100000:3.0:1789672961.347062:0:6523:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8cfc5cf63800:6523] 0 exiting: rc = 1 00000100:00100000:1.0:1789672961.347336:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347343:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347348:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347353:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347358:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347363:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347367:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347373:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347380:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347385:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347391:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347396:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347401:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347406:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347411:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347416:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347421:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347426:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347431:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347436:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347441:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347447:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347452:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347468:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347473:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347478:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347483:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347487:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347492:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347498:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347502:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347507:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347512:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347516:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347521:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347526:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347531:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347536:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347541:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347546:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347551:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347556:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347561:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347566:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347571:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347576:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347581:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347586:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347591:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347596:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347601:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347607:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347612:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347617:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347622:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347628:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347633:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347637:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347650:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347655:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347943:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347948:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347952:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.347957:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672961.349107:0:6525:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8cfc43e65000:6525] 0 exiting: rc = 1 00000100:00100000:3.0:1789672961.349450:0:6526:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8cfc43e64600:6526] 1 exiting: rc = 0 00000100:00100000:0.0:1789672961.349636:0:6527:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8cfc5cf63e00:6527] 2 exiting: rc = 0 00000100:00100000:1.0:1789672961.349917:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.349925:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.349930:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.349944:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.349951:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.349958:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.349964:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.349970:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.349987:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.349993:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.349999:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350004:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350009:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350015:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350020:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350026:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350031:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350037:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350043:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350050:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350224:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350234:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350240:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350245:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350250:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350256:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350261:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350266:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350272:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350290:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350296:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350302:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350309:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350314:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350321:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350327:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350333:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350339:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350345:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350350:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350356:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350362:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350368:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350375:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350394:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350401:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350407:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350414:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350419:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350425:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350432:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350438:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350444:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350450:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350457:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350462:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350468:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350473:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350479:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350485:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350490:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350496:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350502:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672961.350507:0:15350:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789672961.363134:0:15350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789672961.364125:0:15350:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789672961.364133:0:15350:0:(genops.c:885:class_export_put()) final put ffff8cfc499db000/MDS_uuid 00000020:00000080:0.0:1789672961.364219:0:15350:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc499db000/MDS_uuid for MDS 00000020:01000000:0.0:1789672961.364226:0:15350:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789672961.364407:0:15350:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1789672962.256428:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672963.270263:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672964.292257:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789672964.419977:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789672964.419986:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789672964.420005:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789672964.420009:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789672964.420013:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfc462e3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789672964.420020:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 437 00000100:00080000:2.0:1789672964.420026:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789672964.420037:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cfc462e3000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789672964.420086:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7f714700 x1876607738484608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789672964.420150:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789672964.420154:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789672964.420156:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfb4769a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789672964.420159:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 437 00000100:00080000:2.0:1789672964.420162:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789672964.420166:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cfb4769a800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789672964.420176:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7f716a00 x1876607738484864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789672964.420220:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876607738484992:0@lo:400:kworker.0 00000400:00000100:2.0:1789672964.420267:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876607738484992 offset 0 length 224: 4 00000100:00100000:2.0:1789672964.420321:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789672964.420328:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738484736:0@lo:400:kworker.0 00000400:00000100:2.0:1789672964.420345:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876607738484736 offset 0 length 224: 4 00000100:00100000:1.0:1789672964.420812:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876607738484608:0@lo:38:kworker.0 00000400:00000100:1.0:1789672964.420835:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876607738484608 offset 0 length 520: 4 00000100:00100000:1.0:1789672964.420852:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876607738484864:0@lo:38:kworker.0 00000400:00000100:1.0:1789672964.420864:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876607738484864 offset 0 length 520: 4 00010000:00010000:1.0:1789672965.317994:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789672965.444284:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789672965.444297:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789672965.444301:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789672965.444325:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789672965.444382:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789672965.444385:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789672965.444439:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738485120:0@lo:400:kworker.0 00000400:00000100:2.0:1789672965.444510:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876607738485120 offset 0 length 224: 4 00000100:00100000:2.0:1789672965.444576:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789672965.444582:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738485248:0@lo:400:kworker.0 00000400:00000100:2.0:1789672965.444596:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876607738485248 offset 0 length 224: 4 00000020:01000004:1.0:1789672966.001367:0:15551:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789672966.021137:0:15551:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789672966.021200:0:15551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965064 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672966.021216:0:15551:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9965064 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672966.021224:0:15551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9965064 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672966.021232:0:15551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9965064 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672966.021249:0:15551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789672966.021255:0:15551:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1789672966.021282:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672966.021288:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9965064 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672966.021295:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61609000 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789672966.021299:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9965064 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672966.021308:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c9965064 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672966.021316:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c9965064 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672966.021336:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789672966.021338:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789672966.021341:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789672966.021357:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfc499da000 00010000:00010000:0.0:1789672966.021361:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c78c4f8c9965064 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672966.021368:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc61609000/0x6c78c4f8c996505d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c78c4f8c9965064 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672966.021379:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672966.021381:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672966.021383:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789672966.021398:0:15551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789672966.021409:0:15551:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc7f714700 x1876607738484608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789672979 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672966.021425:0:15551:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789672966.021454:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc462e3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789672966.021459:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1789672966.021463:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876607738484608:0@lo:38:kworker.0 00000100:00080000:0.0:1789672966.021494:0:15551:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789672966.021499:0:15551:0:(import.c:65:import_set_state_nolock()) ffff8cfc462e3000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789672966.021504:0:15551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789672966.021507:0:15551:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789672966.021510:0:15551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789672966.022332:0:15551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789672966.022340:0:15551:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc7f714e00 x1876607738484736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672980 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672966.022367:0:15551:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc7f717100 x1876607738485120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672981 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672966.022384:0:15551:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:0.0:1789672966.022408:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738484736:0@lo:400:kworker.0 00000100:00080000:0.0:1789672966.022430:0:15551:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789672966.022452:0:15551:0:(import.c:65:import_set_state_nolock()) ffff8cfb419e3000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789672966.022477:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1876607738485376:0@lo:39:umount.0 00000400:00000100:0.0:1789672966.022520:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876607738485376 offset 0 length 224: 4 00000100:00100000:3.0:1789672966.023737:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738485120:0@lo:400:kworker.0 00010000:00010000:0.0:1789672966.339872:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789672966.993117:0:9507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789672966.993129:0:9507:0:(genops.c:885:class_export_put()) final put ffff8cfb468c5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789672966.993221:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb468c5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789672966.993277:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb468c0800 for lustre-OST0001 00000001:00100000:1.0:1789672966.994452:0:8423:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789672966.994461:0:8423:0:(genops.c:885:class_export_put()) final put ffff8cfc81a25000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789672966.994532:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc81a25000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789672966.994578:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc81a23800 for lustre-OST0000 00010000:00010000:1.0:1789672967.363828:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672968.387894:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672969.411825:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789672969.475776:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789672969.475785:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789672969.475789:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789672969.475792:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789672969.475930:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738485504:0@lo:400:kworker.0 00000400:00000100:3.0:1789672969.475985:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876607738485504 offset 0 length 224: 4 00000100:00100000:0.0:1789672970.115799:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789672960/real 1789672960] req@ffff8cfc462dc000 x1876607738484480/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789672970 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672970.115845:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfc462dc000 x1876607738484480/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789672970 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789672970.115867:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc499da000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789672970.115895:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789672970.115900:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3634:1876607738484480:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1789672970.116209:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789672970.116216:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789672970.116219:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfc499da000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789672970.116224:0:37:0:(import.c:545:import_select_connection()) MGC192.168.201.150@tcp: connect to NID 0@lo last attempt 438 00000100:00080000:2.0:1789672970.116229:0:37:0:(import.c:630:import_select_connection()) MGC192.168.201.150@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789672970.116240:0:37:0:(import.c:666:import_select_connection()) MGC192.168.201.150@tcp: import ffff8cfc499da000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789672970.116278:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7f714000 x1876607738485632/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789672970.116316:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789672970.116320:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789672970.116428:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876607738485760:0@lo:400:kworker.0 00000400:00000100:1.0:1789672970.116501:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876607738485760 offset 0 length 224: 4 00000100:00100000:0.0:1789672970.116777:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3634:1876607738485632:0@lo:250:kworker.0 00000400:00000100:0.0:1789672970.116802:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876607738485632 offset 0 length 520: 4 00010000:00010000:1.0:1789672970.435905:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672971.460558:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672972.485452:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789672973.507809:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672974.532244:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789672975.172681:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789672975.172689:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789672975.172692:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789672975.172696:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789672975.173156:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738485888:0@lo:400:kworker.0 00000400:00000100:3.0:1789672975.173213:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876607738485888 offset 0 length 224: 4 00010000:00010000:0.0:1789672975.556068:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789672976.261038:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789672966/real 1789672966] req@ffff8cfc462df800 x1876607738485376/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789672976 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672976.261084:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfc462df800 x1876607738485376/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789672976 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789672976.261109:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb419e3000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789672976.261206:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1876607738485376:0@lo:39:umount.0 00000100:00080000:1.0:1789672976.266933:0:15551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789672976.266947:0:15551:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789672976.266957:0:15551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789672976.274192:0:15551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965072 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672976.274219:0:15551:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9965072 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672976.274227:0:15551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9965072 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672976.274236:0:15551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9965072 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672976.276752:0:15551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789672976.276769:0:15551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99652e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672976.277280:0:15551:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99652e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672976.277290:0:15551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c99652e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672976.277301:0:15551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c99652e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672976.277316:0:15551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789672976.277323:0:15551:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789672976.277394:0:15551:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789672976.277400:0:15551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789672976.277408:0:15551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789672976.277415:0:15551:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789672976.277420:0:15551:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8cfc67f0b380) has no exports 00000020:00080000:1.0:1789672976.277452:0:15551:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8cfc67f0b380) has no exports 00010000:00010000:0.0:1789672976.277725:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789672976.277735:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9965072 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672976.277744:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc40030600 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789672976.277751:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9965072 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672976.277769:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c9965072 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672976.277780:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c9965072 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672976.277786:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789672976.277789:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789672976.277795:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789672976.277812:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfc499da000 00010000:00010000:0.0:1789672976.277816:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c78c4f8c9965072 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672976.277841:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc40030600/0x6c78c4f8c996506b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c78c4f8c9965072 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672976.277869:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672976.277873:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c99652e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672976.277878:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd400 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789672976.277882:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c99652e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672976.277889:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c99652e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672976.277895:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c99652e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672976.277901:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789672976.277903:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789672976.277905:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789672976.277912:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfc499da000 00010000:00010000:0.0:1789672976.277914:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c78c4f8c99652e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672976.277921:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c99652e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c78c4f8c99652e8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672976.277930:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672976.277935:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672976.277942:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672976.280310:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789672976.286721:0:15551:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfc49cf31e0 - data ffff8cfb45c3e5e8/ffff8cfc462bf800 00000020:01000000:0.0:1789672976.290238:0:15551:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfc8150d720 - data ffff8cfc786a5ca8/ffff8cfb468b6000 00100000:10000000:0.0:1789672976.317703:0:15551:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789672976.337385:0:15551:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964dbd 00000020:00000080:2.0:1789672976.337401:0:15551:0:(genops.c:885:class_export_put()) final put ffff8cfb419e2800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789672976.337480:0:15551:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfc816a3000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789672976.337484:0:15551:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfc816a3000 2 00000020:01000004:2.0:1789672976.337488:0:15551:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cfc816a3000 from lustre-OST0000 00000020:00000080:2.0:1789672976.337513:0:15551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789672976.337524:0:15551:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789672976.337528:0:15551:0:(genops.c:885:class_export_put()) final put ffff8cfb419e0000/lustre-OST0000_UUID 00000020:00000080:2.0:1789672976.337531:0:15551:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb419e0000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789672976.337544:0:15551:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789672976.337611:0:15551:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789672976.337616:0:15551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789672976.337620:0:15551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789672976.337624:0:15551:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789672976.337631:0:15551:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8cfc499df000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789672976.337637:0:15551:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff8cfb4661cd40) has exports, disconnecting them 00000020:00080000:2.0:1789672976.337642:0:15551:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8cfc499df000), last request at 1789672734 00000020:00000080:2.0:1789672976.337646:0:15551:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964de7 00000020:00080000:2.0:1789672976.337682:0:15551:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfc499df000): rc 0 00000020:00000080:2.0:1789672976.337712:0:15551:0:(genops.c:885:class_export_put()) final put ffff8cfc499df000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789672976.340843:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb419e2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789672976.352966:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc499df000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789672976.353024:0:15551:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789672976.353029:0:15551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789672976.353034:0:15551:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789672976.353039:0:15551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789672976.353119:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc462e3000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789672976.353371:0:15551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789672976.353403:0:15551:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789672976.353411:0:15551:0:(genops.c:885:class_export_put()) final put ffff8cfc7c49b800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789672976.353417:0:15551:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc7c49b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789672976.353433:0:15551:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1789672976.353561:0:15551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789672976.353567:0:15551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789672976.353576:0:15551:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789672976.353586:0:15551:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8cfb45b3c000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789672976.353596:0:15551:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff8cfb467719c0) has exports, disconnecting them 00000020:00080000:3.0:1789672976.353604:0:15551:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8cfb45b3c000), last request at 1789672734 00000020:00000080:3.0:1789672976.353611:0:15551:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964dfc 00000020:00080000:3.0:1789672976.353637:0:15551:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfb45b3c000): rc 0 00000020:00000080:3.0:1789672976.353645:0:15551:0:(genops.c:885:class_export_put()) final put ffff8cfb45b3c000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789672976.357134:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb45b3c000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1789672976.361772:0:15551:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789672976.361785:0:15551:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789672976.361791:0:15551:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789672976.361802:0:15551:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789672976.361879:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb419e3000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789672976.362161:0:15551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789672976.362173:0:15551:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1789672976.362179:0:15551:0:(genops.c:885:class_export_put()) final put ffff8cfb419e1000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1789672976.362184:0:15551:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb419e1000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1789672976.362201:0:15551:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1789672976.362298:0:15551:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfc816a3000 1 00000020:00000080:1.0:1789672976.362306:0:15551:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964d85 00000020:00000080:1.0:1789672976.362314:0:15551:0:(genops.c:885:class_export_put()) final put ffff8cfc49cb0800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789672976.362324:0:15551:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789672976.362333:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc49cb0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789672976.362343:0:15551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789672976.362348:0:15551:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789672976.362353:0:15551:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8cfc74594d40) has no exports 00000020:00000080:1.0:1789672976.468501:0:15551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789672976.468526:0:15551:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789672976.468536:0:15551:0:(genops.c:885:class_export_put()) final put ffff8cfc816a7800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789672976.468543:0:15551:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc816a7800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789672976.468567:0:15551:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789672976.468779:0:15551:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cfc816a4800 00000020:02000400:1.0:1789672976.471413:0:15551:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789672976.579799:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672977.611948:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789672978.633043:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789672979.332744:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789672964/real 1789672964] req@ffff8cfc7f716a00 x1876607738484864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789672979 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672979.332780:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfc7f716a00 x1876607738484864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789672979 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789672979.332806:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb4769a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789672979.332836:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789672979.332841:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876607738484864:0@lo:38:kworker.0 00000100:00080000:0.0:1789672979.332867:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789672979.332875:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789672979.332878:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789672979.332882:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789672979.332886:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfb4769a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789672979.332893:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 442 00000100:00080000:0.0:1789672979.332900:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789672979.332913:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cfb4769a800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789672979.332957:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc462df800 x1876607738486016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789672979.333042:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789672979.333057:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738486144:0@lo:400:kworker.0 00000400:00000100:0.0:1789672979.333124:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876607738486144 offset 0 length 224: 4 00000100:00100000:1.0:1789672979.333339:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876607738486016:0@lo:38:kworker.0 00000400:00000100:1.0:1789672979.333374:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876607738486016 offset 0 length 520: 4 00010000:00010000:3.0:1789672979.653698:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1789672980.293359:0:3638:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789672964/real 1789672964] req@ffff8cfc7f717b80 x1876607738484992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789672980 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672980.342064:0:3638:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8cfc7f717b80 x1876607738484992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789672980 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789672980.342084:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8cfb46bf0800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789672980.342089:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789672980.368422:0:3638:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1789672980.369317:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789672980.369329:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789672980.369333:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789672980.369337:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789672980.369340:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789672980.369343:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789672980.369348:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfb46bf0800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789672980.369360:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 238 00000100:00080000:2.0:1789672980.369384:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8cfb46bf0800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789672980.369449:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7f714380 x1876607738486272/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789672980.369515:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1876607738486272:0@lo:38:kworker.0 00000400:00000100:2.0:1789672980.369584:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876607738486272 offset 0 length 520: 4 00000100:00100000:1.0:1789672980.376301:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876607738484992:0@lo:400:kworker.0 00010000:00010000:3.0:1789672980.676337:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789672980.972243:0:15753:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789672980.999008:0:15753:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789672980.999111:0:15753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965048 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672980.999126:0:15753:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9965048 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672980.999133:0:15753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9965048 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672980.999140:0:15753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9965048 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672980.999167:0:15753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789672980.999172:0:15753:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789672980.999200:0:15753:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789672980.999211:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc462df800 x1876607738486016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789672999 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672980.999226:0:15753:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789672980.999232:0:15753:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789672980.999238:0:15753:0:(import.c:65:import_set_state_nolock()) ffff8cfb4769a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789672980.999244:0:15753:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789672980.999247:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc462df800 x1876607738486016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789672999 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789672980.999269:0:15753:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789672980.999273:0:15753:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:0.0:1789672980.999371:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789672980.999385:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9965048 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672980.999394:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8a0600 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789672980.999397:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9965048 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672980.999406:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c9965048 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789672980.999414:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c9965048 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789672980.999419:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789672980.999421:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789672980.999424:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789672980.999436:0:6499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfc499da000 00010000:00010000:0.0:1789672980.999441:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c78c4f8c9965048 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672980.999448:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8a0600/0x6c78c4f8c9965041 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c78c4f8c9965048 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672980.999459:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672980.999461:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789672980.999462:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789672980.999545:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876607738486016:0@lo:38:kworker.0 00000100:00080000:0.0:1789672981.004409:0:15753:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789672981.004430:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc7f717800 x1876607738485248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672981 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672981.004460:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc7f714a80 x1876607738485504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672985 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672981.004502:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc7f716d80 x1876607738485760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672986 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672981.004513:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc7f715180 x1876607738485888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672991 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672981.004523:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc462dc000 x1876607738486144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672995 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672981.004530:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc7f714380 x1876607738486272/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789672990 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672981.004540:0:15753:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789672981.004546:0:15753:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789672981.004552:0:15753:0:(import.c:65:import_set_state_nolock()) ffff8cfb46bf0800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789672981.004603:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738485504:0@lo:400:kworker.0 00000100:00100000:2.0:1789672981.004655:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1876607738486272:0@lo:38:kworker.0 00000100:00080000:0.0:1789672981.004670:0:15753:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789672981.004675:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc7f717800 x1876607738485248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672981 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672981.004686:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc7f716d80 x1876607738485760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672986 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672981.004694:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc7f715180 x1876607738485888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672991 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672981.004701:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc462dc000 x1876607738486144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789672995 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672981.004708:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc7f714380 x1876607738486272/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789672990 ref 1 fl Complete:ENQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789672981.004714:0:15753:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789672981.004913:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738486144:0@lo:400:kworker.0 00000100:00100000:3.0:1789672981.005854:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1876607738485760:0@lo:400:kworker.0 00000100:00100000:0.0:1789672981.008028:0:15753:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:1.0:1789672981.008114:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738485888:0@lo:400:kworker.0 00000100:00100000:1.0:1789672981.008139:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738485248:0@lo:400:kworker.0 00010000:00010000:0.0:1789672981.009652:0:15753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9965056 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672981.009716:0:15753:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9965056 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672981.009723:0:15753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9965056 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672981.009729:0:15753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c9965056 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672981.009755:0:15753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789672981.009763:0:15753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99652da expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672981.009770:0:15753:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99652da expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672981.009776:0:15753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c99652da expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672981.009782:0:15753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6c78c4f8c99652da expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789672981.009796:0:15753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789672981.009800:0:15753:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789672981.009834:0:15753:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789672981.009838:0:15753:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789672981.009843:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789672981.009850:0:15753:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789672981.009854:0:15753:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8cfc7c67cd40) has no exports 00000020:00080000:0.0:1789672981.009883:0:15753:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8cfc7c67cd40) has no exports 00010000:00010000:2.0:1789672981.010077:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789672981.010085:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9965056 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672981.010093:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886600 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:2.0:1789672981.010098:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c9965056 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672981.010115:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c9965056 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672981.010123:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c9965056 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672981.010128:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789672981.010131:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789672981.010133:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1789672981.010146:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfc499da000 00010000:00010000:2.0:1789672981.010150:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c78c4f8c9965056 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672981.010156:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d886600/0x6c78c4f8c996504f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c78c4f8c9965056 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672981.010171:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789672981.010174:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c99652da expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672981.010180:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc61608800 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:2.0:1789672981.010182:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6c78c4f8c99652da expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672981.010189:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c99652da expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672981.010195:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c99652da expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789672981.010344:0:13186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789672981.010438:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789672981.010441:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789672981.010443:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789672981.010451:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfc499da000 00010000:00010000:2.0:1789672981.010454:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c78c4f8c99652da expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672981.010461:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc61608800/0x6c78c4f8c99652d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c78c4f8c99652da expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672981.010474:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672981.010476:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789672981.010478:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789672981.019054:0:15753:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfb4672b720 - data ffff8cfc7873eca8/ffff8cfc7da6fc00 00000020:01000000:0.0:1789672981.021602:0:15753:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cfb4672ba80 - data ffff8cfc78749288/ffff8cfc7f4e5800 00100000:10000000:0.0:1789672981.042024:0:15753:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789672981.090413:0:15753:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964ee3 00000020:00000080:2.0:1789672981.090427:0:15753:0:(genops.c:885:class_export_put()) final put ffff8cfb46bf2800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789672981.090446:0:15753:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfb4676b800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789672981.090450:0:15753:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfb4676b800 2 00000020:01000004:2.0:1789672981.090454:0:15753:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cfb4676b800 from lustre-OST0001 00000020:00000080:2.0:1789672981.090484:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789672981.091955:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb46bf2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789672981.092593:0:15753:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789672981.092603:0:15753:0:(genops.c:885:class_export_put()) final put ffff8cfb46bf0000/lustre-OST0001_UUID 00000020:00000080:2.0:1789672981.092606:0:15753:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb46bf0000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789672981.092614:0:15753:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789672981.095490:0:15753:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7->MGS 00010000:00010000:2.0:1789672981.095515:0:15753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc52434400/0x6c78c4f8c9964c3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c9964c43 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672981.095531:0:15753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52434400/0x6c78c4f8c9964c3c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c9964c43 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672981.095558:0:15753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789672981.095562:0:15753:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789672981.095566:0:15753:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789672981.095590:0:15753:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfc499da000 00010000:00010000:2.0:1789672981.095593:0:15753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc52434400/0x6c78c4f8c9964c3c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c78c4f8c9964c43 expref: -99 pid: 7442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789672981.095613:0:15753:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c99650b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6c78c4f8c99650b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789672981.095630:0:15753:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c99650b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6c78c4f8c99650b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789672981.095635:0:15753:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789672981.095638:0:15753:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789672981.095640:0:15753:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789672981.095674:0:15753:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cfc499da000 00010000:00010000:2.0:1789672981.095677:0:15753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c99650b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6c78c4f8c99650b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789672981.095694:0:15753:0:(import.c:65:import_set_state_nolock()) ffff8cfc499da000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789672981.095699:0:15753:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789672981.095701:0:15753:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789672981.095703:0:15753:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789672981.095708:0:15753:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789672981.095719:0:15753:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cfc7f714000 x1876607738485632/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789672985 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789672981.095872:0:15753:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789672981.095875:0:15753:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:3.0:1789672981.096313:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:79ca85f0-2dcd-4ff4-bdad-0cbec506eae7:3634:1876607738485632:0@lo:250:kworker.0 10000000:01000000:2.0:1789672981.096389:0:15753:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789672981.096404:0:15753:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964b39 00000020:00000080:2.0:1789672981.096413:0:15753:0:(genops.c:885:class_export_put()) final put ffff8cfc499d8000/79ca85f0-2dcd-4ff4-bdad-0cbec506eae7 00000020:01000000:2.0:1789672981.096432:0:15753:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.150@tcp (flags='') 00000020:00000080:2.0:1789672981.096438:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789672981.096446:0:15753:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.150@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789672981.096450:0:15753:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8cfc499cb380) has no exports 10000000:01000000:1.0:1789672981.096508:0:6509:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789672981.096601:0:15753:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.150@tcp: client import never connected 00000100:00080000:2.0:1789672981.096604:0:15753:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789672981.096606:0:15753:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789672981.096609:0:15753:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789672981.096610:0:15753:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789672981.096685:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789672981.096691:0:15753:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.150@tcp (uuid 79ca85f0-2dcd-4ff4-bdad-0cbec506eae7) 00000020:01000000:2.0:1789672981.096700:0:15753:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789672981.096703:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789672981.096707:0:15753:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789672981.096713:0:15753:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8cfb4769d800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789672981.096718:0:15753:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff8cfb46773380) has exports, disconnecting them 00000020:00080000:2.0:1789672981.096723:0:15753:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8cfb4769d800), last request at 1789672760 00000020:00000080:2.0:1789672981.096726:0:15753:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964f0d 00000020:00080000:2.0:1789672981.096738:0:15753:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfb4769d800): rc 0 00000020:00000080:2.0:1789672981.096742:0:15753:0:(genops.c:885:class_export_put()) final put ffff8cfb4769d800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789672981.097740:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc499d8000/79ca85f0-2dcd-4ff4-bdad-0cbec506eae7 for MGC192.168.201.150@tcp 00000020:00000080:3.0:1789672981.097756:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfc499da000 for MGC192.168.201.150@tcp 00000020:00000080:3.0:1789672981.097775:0:8:0:(genops.c:885:class_export_put()) final put ffff8cfc65f5c000/79ca85f0-2dcd-4ff4-bdad-0cbec506eae7 00000020:00000080:3.0:1789672981.097778:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc65f5c000/79ca85f0-2dcd-4ff4-bdad-0cbec506eae7 for MGC192.168.201.150@tcp 00000020:01000000:3.0:1789672981.097783:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.150@tcp (79ca85f0-2dcd-4ff4-bdad-0cbec506eae7) 00000020:00000080:3.0:1789672981.098086:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb4769d800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789672981.098449:0:15753:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789672981.098454:0:15753:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789672981.098459:0:15753:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789672981.098466:0:15753:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789672981.098651:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789672981.098680:0:15753:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1789672981.098689:0:15753:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789672981.098695:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789672981.098699:0:15753:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789672981.098705:0:15753:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8cfb46bf3800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789672981.098711:0:15753:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff8cfb477b0000) has exports, disconnecting them 00000020:00080000:3.0:1789672981.098716:0:15753:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8cfb46bf3800), last request at 1789672760 00000020:00000080:3.0:1789672981.098719:0:15753:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964f22 00000020:00080000:3.0:1789672981.098734:0:15753:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cfb46bf3800): rc 0 00000020:00000080:3.0:1789672981.098739:0:15753:0:(genops.c:885:class_export_put()) final put ffff8cfb46bf3800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789672981.098855:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb4769a800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789672981.098862:0:8:0:(genops.c:885:class_export_put()) final put ffff8cfc462e7800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789672981.098864:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc462e7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789672981.098869:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789672981.098923:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb46bf3800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1789672981.131642:0:15753:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789672981.131852:0:15753:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789672981.131858:0:15753:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789672981.131864:0:15753:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789672981.132074:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cfb46bf0800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1789672981.132706:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789672981.132994:0:13186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789672981.133100:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789672981.133391:0:6494:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8cfc43e35800:6494] 0 exiting: rc = 1 00000100:00100000:2.0:1789672981.133477:0:10391:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8cfb477a5a00:10391] 2 exiting: rc = 0 00000100:00100000:0.0:1789672981.135327:0:6495:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8cfc5f928e00:6495] 1 exiting: rc = 0 00000100:00100000:3.0:1789672981.135470:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.136052:0:7920:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8cfc81793e00:7920] 3 exiting: rc = 0 00000100:00100000:2.0:1789672981.136272:0:6497:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8cfc72ce0400:6497] 1 exiting: rc = 0 00000100:00100000:1.0:1789672981.136362:0:6498:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8cfc72ce1e00:6498] 2 exiting: rc = 0 00000100:00100000:1.0:1789672981.136449:0:6496:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8cfc72ce1600:6496] 0 exiting: rc = 1 00000100:00100000:3.0:1789672981.136505:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136510:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136515:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136520:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136525:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136529:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136533:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136539:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136543:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136547:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136562:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136566:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136570:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136575:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136579:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136582:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136586:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136590:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136595:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136601:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136604:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136608:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136613:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136629:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136635:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136640:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136645:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136650:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136655:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136914:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136918:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136922:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136926:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136929:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136933:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136936:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136940:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136943:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136946:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136949:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136953:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136956:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136959:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136962:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136965:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136975:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136980:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136986:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136991:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.136996:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.137004:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.137009:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.137014:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.137018:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.137023:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.137030:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.137035:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.137040:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.137046:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.137050:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.137056:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.137061:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.137065:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.137070:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789672981.138040:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789672981.138049:0:15753:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1789672981.138055:0:15753:0:(genops.c:885:class_export_put()) final put ffff8cfb46bf3000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1789672981.138058:0:15753:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfb46bf3000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1789672981.138064:0:15753:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1789672981.138118:0:15753:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfb4676b800 1 00000020:00000080:2.0:1789672981.138123:0:15753:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6c78c4f8c9964eb2 00000020:00000080:2.0:1789672981.138139:0:15753:0:(genops.c:885:class_export_put()) final put ffff8cfc81a27000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789672981.138150:0:15753:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789672981.138154:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789672981.138232:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc81a27000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789672981.138268:0:15753:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789672981.138274:0:15753:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff8cfc7c67b380) has no exports 00000020:00000080:1.0:1789672981.184058:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789672981.184075:0:15753:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789672981.184082:0:15753:0:(genops.c:885:class_export_put()) final put ffff8cfc8179e000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789672981.184087:0:15753:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc8179e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789672981.184097:0:15753:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789672981.185752:0:15753:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cfb4676e800 00000020:01000000:1.0:1789672981.185792:0:15753:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789672981.185799:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789672981.185813:0:15753:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789672981.185818:0:15753:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8cfc67f099c0) has no exports 00000020:00000080:1.0:1789672981.185850:0:15753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789672981.185858:0:15753:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789672981.185862:0:15753:0:(genops.c:885:class_export_put()) final put ffff8cfc49cb2000/OSS_uuid 00000020:00000080:1.0:1789672981.185866:0:15753:0:(genops.c:844:class_export_destroy()) destroying export ffff8cfc49cb2000/OSS_uuid for OSS 00000020:01000000:1.0:1789672981.185872:0:15753:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1789672981.187310:0:8430:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8cfc81790200:8430] 2 exiting: rc = 0 00000100:00100000:2.0:1789672981.187414:0:14868:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff8cfb47693a00:14868] 4 exiting: rc = 0 00000100:00100000:2.0:1789672981.187488:0:8428:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8cfc5f928600:8428] 0 exiting: rc = 1 00000100:00080000:0.0:1789672981.187648:0:6508:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789672981.187806:0:8429:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8cfc4ae50800:8429] 1 exiting: rc = 0 00000100:00100000:2.0:1789672981.188939:0:8494:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8cfb45b2ca00:8494] 3 exiting: rc = 0 00000100:00100000:1.0:1789672981.189504:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189513:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189519:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189525:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189533:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189539:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189545:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189550:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189568:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189573:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189585:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189594:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189599:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189605:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189611:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189616:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189631:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189637:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189643:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189649:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189655:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189852:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189858:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189864:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189871:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189876:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189882:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189888:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189907:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189913:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189919:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189925:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189930:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189936:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189943:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189949:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189954:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189959:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189966:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189972:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189979:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189984:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189991:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.189998:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190004:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190009:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190015:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190021:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190026:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190031:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190037:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190043:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190048:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190054:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190061:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190066:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190072:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190078:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190084:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190089:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190095:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190101:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190107:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.190126:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789672981.197788:0:8432:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8cfc4ae51c00:8432] 1 exiting: rc = 0 00000100:00100000:2.0:1789672981.199461:0:10094:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8cfc7dacc200:10094] 2 exiting: rc = 0 00000100:00100000:1.0:1789672981.199743:0:8431:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8cfc4ae51400:8431] 0 exiting: rc = 1 00000100:00100000:0.0:1789672981.199970:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.199981:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.199988:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.199995:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200001:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200006:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200012:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200017:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200023:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200028:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200034:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200039:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200045:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200051:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200057:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200063:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200069:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200076:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200082:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200089:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200094:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200100:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200106:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200113:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200119:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200153:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200167:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200173:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200179:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200192:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200199:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200205:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200212:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200217:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200223:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200231:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200238:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200244:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200250:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200255:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200261:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200267:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200273:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200278:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200284:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200290:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200296:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200303:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200309:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200315:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200321:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200327:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200332:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200338:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200344:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200350:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200357:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200363:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200369:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200374:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200387:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200391:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200397:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.200403:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.203294:0:8434:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8cfc7c4d3400:8434] 1 exiting: rc = 0 00000100:00100000:0.0:1789672981.204010:0:8435:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8cfc7c4d3c00:8435] 2 exiting: rc = 0 00000100:00100000:3.0:1789672981.204518:0:8433:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8cfc81759200:8433] 0 exiting: rc = 1 00000100:00100000:1.0:1789672981.205066:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205075:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205081:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205096:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205104:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205109:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205116:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205301:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205313:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205320:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205327:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205333:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205340:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205346:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205353:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205359:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205365:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205371:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205378:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205385:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205404:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205414:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205421:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205428:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205435:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205442:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205449:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205456:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205461:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205467:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205473:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205478:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205483:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205502:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205508:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205515:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205522:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205529:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205535:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205541:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205547:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205565:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205572:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205578:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205600:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205607:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205614:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205629:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205636:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205642:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205649:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205655:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205699:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205706:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205713:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205719:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205726:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205732:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205741:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205747:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205754:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205942:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205951:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789672981.205959:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.219344:0:8437:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8cfb41a2a600:8437] 1 exiting: rc = 0 00000100:00100000:1.0:1789672981.223888:0:8436:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8cfc7c739e00:8436] 0 exiting: rc = 1 00000100:00100000:3.0:1789672981.224229:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224238:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224244:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224249:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224255:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224262:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224268:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224273:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224279:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224285:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224291:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224312:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224317:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224323:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224328:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224333:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224339:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224344:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224349:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224354:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224359:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224364:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224369:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224374:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224379:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224383:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224388:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224393:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224398:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224406:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224411:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224416:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224421:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224426:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224431:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224437:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224441:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224447:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224456:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224465:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224470:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224475:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224481:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224487:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224491:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224496:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224509:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224514:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224520:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224525:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224530:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224536:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224541:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.224546:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.226005:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.226030:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.226036:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.226041:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.226046:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.226051:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.226056:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.226061:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.226066:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789672981.226079:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.234011:0:8438:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8cfc819fda00:8438] 0 exiting: rc = 1 00000100:00100000:1.0:1789672981.237090:0:8439:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8cfb41ab6a00:8439] 1 exiting: rc = 0 00000100:00100000:0.0:1789672981.241912:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.241937:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.241944:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.241950:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.241955:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.241961:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.241969:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.241975:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.241982:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.241990:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242019:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242027:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242033:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242039:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242045:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242051:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242057:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242065:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242071:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242077:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242085:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242091:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242113:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242120:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242606:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242631:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242640:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242647:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242653:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.242998:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243005:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243012:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243019:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243026:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243051:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243061:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243068:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243074:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243080:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243086:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243093:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243100:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243108:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243115:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243134:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243142:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243164:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243173:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243179:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243185:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243191:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243196:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243202:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243210:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243218:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243224:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243232:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243240:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243261:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243269:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243276:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243282:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243288:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789672981.243302:0:15753:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789672981.257540:0:15753:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789673003.793025:0:16517:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789673017.114347:0:17117:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789673017.114354:0:17117:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789673017.114355:0:17117:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789673017.114446:0:17117:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cfc7f765000 00000020:01000004:3.0:1789673017.114462:0:17117:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789673017.114470:0:17117:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789673017.114483:0:17117:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8cfb46773380) 00000020:00000080:3.0:1789673017.114494:0:17117:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789673017.260579:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789673017.264638:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789673017.268128:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789673017.269410:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789673017.270087:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789673017.280737:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789673017.283043:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789673017.283425:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789673017.284479:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789673017.284788:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789673017.285311:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789673017.285711:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789673017.286641:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789673017.288735:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789673017.295314:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1789673017.300283:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789673017.301773:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789673017.302125:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789673017.302418:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1789673017.303023:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1789673017.303653:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789673017.304735:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1789673017.305011:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1789673017.305239:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789673017.305768:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1789673017.306112:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789673017.306379:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789673017.306892:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789673017.307159:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789673017.307421:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1789673017.307717:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789673017.307946:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789673017.308298:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789673017.308593:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789673017.312116:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1789673017.312693:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789673017.312922:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789673017.313162:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1789673017.313472:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1789673017.313786:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789673017.314264:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789673017.314891:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789673017.315368:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1789673017.315739:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1789673017.315946:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789673017.316251:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1789673017.316568:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789673017.318764:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1789673017.320341:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1789673017.320765:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1789673017.321730:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1789673017.322173:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1789673017.322322:0:17117:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:1.0:1789673017.325132:0:17117:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789673017.325375:0:17117:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789673017.325384:0:17117:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789673017.325397:0:17117:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c78c4f8c99660e8 00000020:01000004:1.0:1789673017.325405:0:17117:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789673017.325411:0:17117:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789673017.325416:0:17117:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfc7f765000 from MGS 00000020:01000004:1.0:1789673017.325420:0:17117:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789673017.325433:0:17117:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8cfb466199c0) 00000020:00000080:1.0:1789673017.325445:0:17117:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789673017.325514:0:17117:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfc7f765000 from MGS, refs=2 00080000:01000000:1.0:1789673017.325518:0:17117:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789673017.325523:0:17117:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c78c4f8c99660f6 00000100:00100000:1.0:1789673017.325640:0:17117:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789673017.326299:0:17117:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789673017.326306:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789673017.332237:0:17117:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789673017.332253:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789673017.338781:0:17117:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789673017.339027:0:17117:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789673017.339034:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789673017.347634:0:17117:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789673017.347689:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789673017.348478:0:17117:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789673017.348498:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789673017.350333:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673017.350339:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673017.350350:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673017.357396:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673017.357404:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673017.357407:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673017.378458:0:17117:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789673017.383127:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789673017.393211:0:17117:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789673017.411817:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789673017.412056:0:17117:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789673017.412209:0:17117:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789673017.413097:0:17117:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789673017.415229:0:17117:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789673017.415434:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789673017.415441:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789673017.417863:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789673017.417874:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789673017.420098:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789673017.420121:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789673017.421019:0:17117:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789673017.421044:0:17117:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.150@tcp' 00000020:01000004:2.0:1789673017.421047:0:17117:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789673017.421081:0:17117:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.150@tcp (typ=mgc) 00000020:00000080:2.0:1789673017.421096:0:17117:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.150@tcp (ffff8cfb477b0000) 00000100:00080000:0.0:1789673017.421230:0:17134:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1789673017.421409:0:17117:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789673017.421568:0:17117:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfb481af800@MGC192.168.201.150@tcp: add connection 192.168.201.150@tcp at head 00010000:00010000:2.0:1789673017.422091:0:17117:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.150@tcp-0 is initialized 00000040:01000000:2.0:1789673017.422099:0:17117:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789673017.428996:0:17135:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789673017.429056:0:17117:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.150@tcp (uuid 056ee8fb-27c3-4ac9-bc74-a01f89cd2976) 00000020:00000080:1.0:1789673017.429085:0:17117:0:(genops.c:1384:class_connect()) connect: client 056ee8fb-27c3-4ac9-bc74-a01f89cd2976, cookie 0x6c78c4f8c9966104 00000100:00080000:1.0:1789673017.429099:0:17117:0:(import.c:545:import_select_connection()) MGC192.168.201.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789673017.429112:0:17117:0:(import.c:666:import_select_connection()) MGC192.168.201.150@tcp: import ffff8cfb481af800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789673017.429162:0:17117:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d8dc700 x1876607738486400/t0(0) o250->MGC192.168.201.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789673017.429185:0:17117:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 056ee8fb-27c3-4ac9-bc74-a01f89cd2976->MGS 00000020:01000004:1.0:1789673017.429205:0:17117:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789673017.429211:0:17117:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789673017.429227:0:17117:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8cfb4661b380) 00000020:00000080:1.0:1789673017.429242:0:17117:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789673017.430024:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3634:1876607738486400:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789673017.430095:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673017.430266:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738486400 00000100:00100000:0.0:1789673017.430274:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738486400 00000100:00100000:0.0:1789673017.430314:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789673017.430322:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3634:x1876607738486400:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789673017.430346:0:17131:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 056ee8fb-27c3-4ac9-bc74-a01f89cd2976@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:0.0:1789673017.430374:0:17131:0:(genops.c:1384:class_connect()) connect: client 056ee8fb-27c3-4ac9-bc74-a01f89cd2976, cookie 0x6c78c4f8c9966112 00000100:00080000:0.0:1789673017.430632:0:17131:0:(import.c:65:import_set_state_nolock()) ffff8cfb4811b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789673017.430718:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+5:3634:x1876607738486400:12345-0@lo:250:mount.lustre.0 Request processed in 393us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673017.430726:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789673017.430808:0:3634:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789673017.430816:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.150@tcp: connect to target with instance 0 00000100:00080000:2.0:1789673017.430824:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789673017.430829:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789673017.430833:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb481af800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789673017.430836:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789673017.430839:0:3634:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789673017.430844:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3634:1876607738486400:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789673017.470930:0:17117:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789673017.471162:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789673017.471169:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789673017.479532:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789673017.479545:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789673017.480321:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789673017.480329:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789673017.481585:0:17117:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789673017.482132:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789673017.482138:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789673017.483010:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789673017.483018:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789673017.543537:0:17117:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789673017.543785:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789673017.543792:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789673017.546566:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789673017.546576:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789673017.553711:0:17117:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789673017.553913:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789673017.553920:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789673017.554735:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789673017.554745:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789673017.557914:0:17117:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789673017.558135:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789673017.558146:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789673017.561797:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789673017.561809:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789673017.562500:0:17117:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789673017.562698:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789673017.562703:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789673017.563266:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789673017.563271:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789673017.607336:0:17117:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789673017.607566:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789673017.607573:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789673017.618192:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789673017.618207:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789673017.619739:0:17117:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789673017.619752:0:17117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789673017.621779:0:17117:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789673017.621816:0:17117:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789673017.621824:0:17117:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789673017.621983:0:17117:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789673017.622032:0:17117:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.150@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789673017.622038:0:17117:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789673017.622040:0:17117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789673017.622042:0:17117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789673017.622043:0:17117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789673017.622044:0:17117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789673017.622045:0:17117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789673017.622047:0:17117:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789673017.622048:0:17117:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789673017.622050:0:17117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789673017.622052:0:17117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789673017.622054:0:17117:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789673017.622057:0:17117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789673017.622058:0:17117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789673017.622060:0:17117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789673017.622060:0:17117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789673017.622061:0:17117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789673017.622063:0:17117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789673017.622064:0:17117:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789673017.622065:0:17117:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789673017.622066:0:17117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789673017.622067:0:17117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789673017.622095:0:17117:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789673017.622119:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738486528:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789673017.622196:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673017.622447:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738486528 00000100:00100000:1.0:1789673017.622455:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738486528 00000100:00100000:1.0:1789673017.622499:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789673017.622509:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+5:17117:x1876607738486528:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789673017.622558:0:17133:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789673017.622561:0:17133:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789673017.622563:0:17133:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:0.0:1789673017.622651:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935600 going to sleep for 11 seconds 10000000:01000000:0.0:1789673017.626229:0:17154:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789673017.626781:0:17133:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1789673017.632575:0:17155:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789673017.632585:0:17155:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789673017.632587:0:17155:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789673017.632590:0:17155:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789673017.632827:0:17155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789673017.633104:0:17133:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789673017.633178:0:17133:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789673017.647609:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+5:17117:x1876607738486528:12345-0@lo:253:mount.lustre.0 Request processed in 25089us (25401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673017.647635:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789673017.647814:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738486528:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789673017.647831:0:17117:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789673017.647834:0:17117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789673017.647836:0:17117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789673017.647838:0:17117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789673017.647839:0:17117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789673017.647840:0:17117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789673017.647841:0:17117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789673017.647842:0:17117:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789673017.647844:0:17117:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789673017.647846:0:17117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789673017.647847:0:17117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789673017.647867:0:17117:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfc7f765000 from lustre-MDT0000 10000000:01000000:0.0:1789673017.647916:0:17117:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789673017.647919:0:17117:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789673017.647924:0:17117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cfb477b0000 10000000:01000000:0.0:1789673017.647928:0:17117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789673017.647937:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cfb477b0000 from 1 10000000:01000000:0.0:1789673017.647941:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789673017.648004:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cc600/0x6c78c4f8c9966119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.648016:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cc600/0x6c78c4f8c9966119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.648025:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cc600/0x6c78c4f8c9966119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673017.648047:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738486656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789673017.648091:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673017.648155:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935480 going to sleep for 11 seconds 00000100:00100000:1.0:1789673017.648995:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738486656 00000100:00100000:1.0:1789673017.649006:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738486656 00000100:00100000:1.0:1789673017.649052:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789673017.649062:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+5:17117:x1876607738486656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789673017.649075:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789673017.649094:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52435800/0x6c78c4f8c9966120 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9966119 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673017.649122:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52435800/0x6c78c4f8c9966120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9966119 expref: 6 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673017.649133:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52435800/0x6c78c4f8c9966120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9966119 expref: 6 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673017.649143:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435800, rc 0) 00000100:00100000:1.0:1789673017.649227:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+6:17117:x1876607738486656:12345-0@lo:101:mount.lustre.0 Request processed in 167us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673017.649235:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789673017.649641:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738486656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789673017.649681:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cc600/0x6c78c4f8c9966119 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966120 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.649693:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cc600/0x6c78c4f8c9966119 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9966120 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673017.654044:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738486784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789673017.654247:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673017.654293:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935480 going to sleep for 11 seconds 00000100:00100000:2.0:1789673017.658470:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738486784 00000100:00100000:2.0:1789673017.658486:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738486784 00000100:00100000:2.0:1789673017.658569:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789673017.658580:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+6:17117:x1876607738486784:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789673017.658783:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+6:17117:x1876607738486784:12345-0@lo:501:mount.lustre.0 Request processed in 205us (4536us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789673017.658793:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789673017.659045:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738486784:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789673017.659099:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789673017.659125:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cc600/0x6c78c4f8c9966119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966120 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.659135:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cc600/0x6c78c4f8c9966119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966120 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789673017.659144:0:17117:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfc7f765000 10000000:01000000:0.0:1789673017.659149:0:17117:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789673017.659154:0:17117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cfc7f765000 10000000:01000000:0.0:1789673017.659157:0:17117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789673017.659160:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cfc7f765000 from 1 10000000:01000000:0.0:1789673017.659164:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789673017.659196:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9966127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.659204:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9966127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.659235:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9966127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673017.659256:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738486912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789673017.659296:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673017.659342:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935480 going to sleep for 11 seconds 00000100:00100000:1.0:1789673017.659445:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738486912 00000100:00100000:1.0:1789673017.659451:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738486912 00000100:00100000:1.0:1789673017.659490:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789673017.659499:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+6:17117:x1876607738486912:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789673017.659509:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789673017.659524:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52435200/0x6c78c4f8c996612e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9966127 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673017.659547:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52435200/0x6c78c4f8c996612e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9966127 expref: 7 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673017.659558:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52435200/0x6c78c4f8c996612e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9966127 expref: 7 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673017.659567:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435200, rc 0) 00000100:00100000:1.0:1789673017.659599:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+7:17117:x1876607738486912:12345-0@lo:101:mount.lustre.0 Request processed in 102us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673017.659605:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789673017.660360:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738486912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789673017.660380:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9966127 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996612e expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.660391:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9966127 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996612e expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789673017.660406:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789673017.660411:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9966127 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996612e expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.660418:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cda00/0x6c78c4f8c9966127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996612e expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789673017.660425:0:17117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789673017.660432:0:17117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789673017.660437:0:17117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cfc7f765000 10000000:01000000:0.0:1789673017.660440:0:17117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789673017.660444:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789673017.660447:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789673017.660465:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cdc00/0x6c78c4f8c9966135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.660483:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cdc00/0x6c78c4f8c9966135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.660492:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cdc00/0x6c78c4f8c9966135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673017.660507:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738487040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789673017.660543:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673017.660580:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935480 going to sleep for 11 seconds 00000100:00100000:0.0:1789673017.660602:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738487040 00000100:00100000:0.0:1789673017.660608:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738487040 00000100:00100000:0.0:1789673017.660641:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789673017.660651:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+7:17117:x1876607738487040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789673017.660678:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673017.660690:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8cd200/0x6c78c4f8c996613c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9966135 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.660707:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8cd200/0x6c78c4f8c996613c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9966135 expref: 8 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.660716:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8cd200/0x6c78c4f8c996613c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9966135 expref: 8 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.660722:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cd200, rc 0) 00000100:00100000:0.0:1789673017.660758:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+8:17117:x1876607738487040:12345-0@lo:101:mount.lustre.0 Request processed in 110us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673017.660766:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789673017.660803:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738487040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789673017.661553:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cdc00/0x6c78c4f8c9966135 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996613c expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.661567:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cdc00/0x6c78c4f8c9966135 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996613c expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673017.661645:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738487168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789673017.661710:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673017.661748:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935480 going to sleep for 11 seconds 00000100:00100000:1.0:1789673017.661767:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738487168 00000100:00100000:1.0:1789673017.661775:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738487168 00000100:00100000:1.0:1789673017.661815:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789673017.661823:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+8:17117:x1876607738487168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789673017.661987:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+9:17117:x1876607738487168:12345-0@lo:501:mount.lustre.0 Request processed in 164us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673017.661995:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789673017.664465:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738487168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789673017.664539:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738487296:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789673017.664630:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673017.664715:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d935480 going to sleep for 11 seconds 00000100:00100000:1.0:1789673017.664723:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738487296 00000100:00100000:1.0:1789673017.664733:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738487296 00000100:00100000:1.0:1789673017.664787:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789673017.664796:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+9:17117:x1876607738487296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789673017.665980:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+9:17117:x1876607738487296:12345-0@lo:503:mount.lustre.0 Request processed in 1168us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673017.665993:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789673017.666382:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738487296:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789673017.669017:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17156:1876607738487424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789673017.669102:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673017.669158:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d9353c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789673017.669196:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738487424 00000100:00100000:1.0:1789673017.669205:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738487424 00000100:00100000:1.0:1789673017.669258:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789673017.669269:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+9:17156:x1876607738487424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789673017.670993:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+9:17156:x1876607738487424:12345-0@lo:502:llog_process_th.0 Request processed in 1342us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673017.671008:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789673017.671090:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17156:1876607738487424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789673017.671204:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789673017.671217:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.671220:0:17156:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789673017.671225:0:17156:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789673017.671229:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789673017.671249:0:17156:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8cfb4661cd40) 00000020:00000080:1.0:1789673017.671272:0:17156:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789673017.671279:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789673017.671382:0:17156:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789673017.671391:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c78c4f8c996614a 00000020:00000080:1.0:1789673017.672782:0:17156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789673017.672790:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789673017.672794:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.672808:0:17156:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789673017.672811:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789673017.672814:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.672815:0:17156:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789673017.672817:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789673017.672827:0:17156:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8cfb46618000) 00000020:00000080:1.0:1789673017.672839:0:17156:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789673017.672842:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789673017.672843:0:17156:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789673017.672846:0:17156:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789673017.672849:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789673017.672918:0:17156:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfc7f765000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789673017.672928:0:17156:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8cfc499cb380) 00000020:00000080:1.0:1789673017.672935:0:17156:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789673017.672994:0:17156:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789673017.673001:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c78c4f8c996615f 00000020:00000080:1.0:1789673017.673108:0:17156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789673017.673114:0:17156:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789673017.673119:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6c78c4f8c9966166 00080000:01000000:1.0:1789673017.673126:0:17156:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789673017.673129:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c78c4f8c996616d 00010000:00010000:1.0:1789673017.738353:0:17156:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789673017.739352:0:17156:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:1.0:1789673017.740045:0:17156:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789673017.740491:0:17156:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8cfc499ccd40) 00000020:00000080:1.0:1789673017.740510:0:17156:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789673017.740645:0:17156:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789673017.740653:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c78c4f8c996617b 00000020:00000080:0.0:1789673017.741763:0:17156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789673017.751192:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6c78c4f8c9966182 00000020:00000080:1.0:1789673017.754897:0:17156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789673017.754917:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789673017.754928:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.754931:0:17156:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789673017.754935:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789673017.754955:0:17156:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1789673017.754958:0:17156:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789673017.754959:0:17156:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789673017.754961:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789673017.754964:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.754978:0:17156:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789673017.754981:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789673017.754987:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.754988:0:17156:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789673017.754993:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789673017.755056:0:17156:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789673017.755073:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789673017.755077:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.755078:0:17156:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789673017.755081:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789673017.755084:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.755086:0:17156:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789673017.755089:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789673017.755095:0:17156:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:00000080:1.0:1789673017.755126:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789673017.755144:0:17156:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8cfc499c99c0) 00000020:00000080:1.0:1789673017.755166:0:17156:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789673017.755171:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789673017.755505:0:17156:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789673017.755511:0:17156:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789673017.755520:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c78c4f8c9966190 00010000:00080000:1.0:1789673017.755558:0:17156:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfc458c3000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:1.0:1789673017.761822:0:17156:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789673017.767363:0:17156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789673017.767384:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789673017.768053:0:17156:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789673017.768080:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c78c4f8c9966197 00000100:00080000:1.0:1789673017.768094:0:17156:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789673017.768119:0:17156:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cfc458c3000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789673017.768777:0:17156:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d8dc380 x1876607738487552/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789673017.768807:0:17156:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1789673017.768925:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789673017.768931:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.768933:0:17156:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789673017.768936:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789673017.768939:0:17156:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1789673017.768941:0:17156:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789673017.768943:0:17156:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789673017.768944:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789673017.768947:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.768948:0:17156:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789673017.768950:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789673017.768955:0:17156:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789673017.768958:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.768959:0:17156:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789673017.768962:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789673017.768974:0:17156:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:1.0:1789673017.769001:0:17156:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789673017.769005:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789673017.769020:0:17156:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cfc499c8000) 00000020:00000080:1.0:1789673017.769036:0:17156:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789673017.769043:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789673017.769118:0:17156:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789673017.769125:0:17156:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789673017.769132:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c78c4f8c99661a5 00010000:00080000:1.0:1789673017.769164:0:17156:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfb4693c000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:1.0:1789673017.769422:0:17156:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1789673017.771109:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738487552:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789673017.771195:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673017.772553:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738487552 00000100:00100000:1.0:1789673017.772575:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738487552 00000100:00100000:1.0:1789673017.772623:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789673017.772632:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876607738487552:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1789673017.772654:0:17143:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1789673017.783741:0:17156:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789673017.785615:0:17156:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1789673017.795985:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876607738487552:12345-0@lo:38:llog_process_th.0 Request processed in 23336us (24771us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789673017.796002:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789673017.796070:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c3000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789673017.796076:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789673017.796081:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738487552:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789673017.805885:0:17156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789673017.808474:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789673017.808731:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789673017.809650:0:17162:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789673017.809677:0:17162:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789673017.811214:0:17156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789673017.812643:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789673017.812770:0:17156:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789673017.812796:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c78c4f8c99661ac 00000100:00080000:1.0:1789673017.812809:0:17156:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789673017.812824:0:17156:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cfb4693c000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789673017.812861:0:17156:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d8dc380 x1876607738487680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789673017.813093:0:17156:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1789673017.813272:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738487680:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789673017.813342:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876607738487680 offset 0 length 520: 4 00000020:01000000:1.0:1789673017.815133:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789673017.815142:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.815144:0:17156:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789673017.815149:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789673017.815152:0:17156:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789673017.815154:0:17156:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789673017.815155:0:17156:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789673017.815157:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789673017.815159:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.815160:0:17156:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789673017.815163:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789673017.815181:0:17156:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789673017.815186:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.815187:0:17156:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789673017.815191:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789673017.815196:0:17156:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:1.0:1789673017.815238:0:17156:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789673017.815242:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789673017.815279:0:17156:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cfc497bcd40) 00000020:00000080:1.0:1789673017.815304:0:17156:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1789673017.815312:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789673017.815409:0:17156:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789673017.815416:0:17156:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789673017.815423:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6c78c4f8c99661ba 00010000:00080000:1.0:1789673017.815457:0:17156:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfc458c7800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:1.0:1789673017.815762:0:17156:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789673017.815848:0:17156:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789673017.815865:0:17156:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789673017.821536:0:17156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789673017.821778:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789673017.821921:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1789673017.822403:0:17164:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789673017.822409:0:17164:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789673017.824694:0:17156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789673017.824723:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789673017.825221:0:17156:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789673017.825485:0:17156:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c78c4f8c99661c1 00000100:00080000:0.0:1789673017.825498:0:17156:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789673017.825511:0:17156:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfc458c7800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789673017.825905:0:17156:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc462ddf80 x1876607738487808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789673017.826072:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738487808:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789673017.826146:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876607738487808 offset 0 length 520: 4 00000100:00080000:1.0:1789673017.827044:0:17156:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789673017.827319:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789673017.827327:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.827329:0:17156:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789673017.827335:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789673017.827339:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.827341:0:17156:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789673017.827344:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789673017.827346:0:17156:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789673017.827349:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789673017.827351:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.827353:0:17156:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789673017.827355:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789673017.827357:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673017.827358:0:17156:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789673017.827372:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789673017.827408:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17156:1876607738487936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789673017.827472:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673017.827507:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc65c23e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789673017.827524:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738487936 00000100:00100000:0.0:1789673017.827532:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738487936 00000100:00100000:0.0:1789673017.827588:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789673017.827598:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+9:17156:x1876607738487936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789673017.827807:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+9:17156:x1876607738487936:12345-0@lo:502:llog_process_th.0 Request processed in 210us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673017.827815:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789673017.827865:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17156:1876607738487936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789673017.827912:0:17156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789673017.827918:0:17156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789673017.827920:0:17156:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789673017.827925:0:17156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789673017.828828:0:17117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789673017.828851:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789673017.828867:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cdc00/0x6c78c4f8c9966135 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996613c expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673017.828887:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cdc00/0x6c78c4f8c9966135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996613c expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789673017.828894:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfc7f765000 from 1 10000000:01000000:1.0:1789673017.828896:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789673017.828923:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52434800/0x6c78c4f8c99661c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673017.828928:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc52434800/0x6c78c4f8c99661c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673017.828935:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc52434800/0x6c78c4f8c99661c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673017.828947:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738488064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789673017.828993:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673017.829032:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d839c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789673017.830080:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738488064 00000100:00100000:0.0:1789673017.830089:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738488064 00000100:00100000:0.0:1789673017.830435:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789673017.830443:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+9:17117:x1876607738488064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789673017.830456:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673017.830471:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8cd400/0x6c78c4f8c99661cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99661c8 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.830492:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8cd400/0x6c78c4f8c99661cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99661c8 expref: 10 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.830500:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8cd400/0x6c78c4f8c99661cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99661c8 expref: 10 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.830506:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cd400, rc 0) 00000100:00100000:0.0:1789673017.830561:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+10:17117:x1876607738488064:12345-0@lo:101:mount.lustre.0 Request processed in 120us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673017.830566:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789673017.830791:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738488064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789673017.830806:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc52434800/0x6c78c4f8c99661c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99661cf expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673017.830820:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc52434800/0x6c78c4f8c99661c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99661cf expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673017.831788:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738488192:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789673017.831840:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673017.831877:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d839c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789673017.831886:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738488192 00000100:00100000:0.0:1789673017.831892:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738488192 00000100:00100000:0.0:1789673017.831941:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789673017.831949:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+10:17117:x1876607738488192:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789673017.831978:0:17132:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789673017.831984:0:17132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789673017.832067:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+10:17117:x1876607738488192:12345-0@lo:256:mount.lustre.0 Request processed in 118us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673017.832076:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789673017.832092:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738488192:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789673017.832723:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789673017.832750:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52434800/0x6c78c4f8c99661c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99661cf expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673017.832763:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc52434800/0x6c78c4f8c99661c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99661cf expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789673017.832837:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc7f765000 from 1 10000000:01000000:3.0:1789673017.832841:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789673017.832870:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5200/0x6c78c4f8c99661d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673017.832886:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5200/0x6c78c4f8c99661d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673017.832893:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5200/0x6c78c4f8c99661d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673017.832904:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f649180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738488320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789673017.832935:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673017.832960:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc65c1d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789673017.833031:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738488320 00000100:00100000:1.0:1789673017.833037:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738488320 00000100:00100000:1.0:1789673017.833080:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789673017.833089:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+10:17117:x1876607738488320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789673017.833099:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789673017.833576:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c99661dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99661d6 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673017.833600:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c99661dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99661d6 expref: 11 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673017.833610:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c99661dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99661d6 expref: 11 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673017.833619:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434200, rc 0) 00000100:00100000:1.0:1789673017.834537:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+11:17117:x1876607738488320:12345-0@lo:101:mount.lustre.0 Request processed in 1448us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673017.834547:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789673017.834801:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f649180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738488320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789673017.834825:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5200/0x6c78c4f8c99661d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99661dd expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673017.834836:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5200/0x6c78c4f8c99661d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99661dd expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673017.835352:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f649180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738488448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789673017.835493:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673017.835598:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc65c1d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789673017.836044:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738488448 00000100:00100000:1.0:1789673017.836050:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738488448 00000100:00100000:1.0:1789673017.836091:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789673017.836178:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+11:17117:x1876607738488448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789673017.836376:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+11:17117:x1876607738488448:12345-0@lo:501:mount.lustre.0 Request processed in 268us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673017.836384:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789673017.836525:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f649180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738488448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789673017.836579:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f649180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738488576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789673017.836623:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673017.836710:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc65c1d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789673017.836751:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738488576 00000100:00100000:1.0:1789673017.836756:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738488576 00000100:00100000:1.0:1789673017.836790:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789673017.836799:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+11:17117:x1876607738488576:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789673017.837018:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+11:17117:x1876607738488576:12345-0@lo:503:mount.lustre.0 Request processed in 221us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673017.837024:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789673017.837081:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f649180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738488576:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789673017.837625:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17166:1876607738488704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789673017.837756:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673017.837869:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738488704 00000100:00100000:1.0:1789673017.837874:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738488704 00000100:00100000:1.0:1789673017.838035:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789673017.838042:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+11:17166:x1876607738488704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789673017.838593:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45b3fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789673017.838991:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+11:17166:x1876607738488704:12345-0@lo:502:llog_process_th.0 Request processed in 948us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673017.838998:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789673017.839050:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17166:1876607738488704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789673017.839088:0:17166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789673017.839100:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789673017.839103:0:17166:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789673017.839110:0:17166:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfc7f765000 00000020:00000080:2.0:1789673017.839113:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789673017.839122:0:17166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789673017.839125:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789673017.839126:0:17166:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789673017.839129:0:17166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789673017.839132:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789673017.839133:0:17166:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789673017.839136:0:17166:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfc7f765000 00000020:00000080:2.0:1789673017.839139:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789673017.839203:0:17166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789673017.839207:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789673017.839208:0:17166:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789673017.839210:0:17166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789673017.839213:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789673017.839214:0:17166:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789673017.839217:0:17166:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfc7f765000 00000020:00000080:2.0:1789673017.839220:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789673017.839237:0:17166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789673017.839239:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789673017.839240:0:17166:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789673017.839242:0:17166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789673017.839245:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789673017.839246:0:17166:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789673017.839249:0:17166:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfc7f765000 00000020:00000080:2.0:1789673017.839251:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789673017.839315:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f714380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17166:1876607738488832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789673017.839360:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673017.839390:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45b99900 going to sleep for 11 seconds 00000100:00100000:1.0:1789673017.839412:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738488832 00000100:00100000:1.0:1789673017.839419:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738488832 00000100:00100000:1.0:1789673017.839462:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789673017.839470:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+11:17166:x1876607738488832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789673017.839563:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+11:17166:x1876607738488832:12345-0@lo:502:llog_process_th.0 Request processed in 94us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673017.839571:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789673017.839708:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f714380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17166:1876607738488832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789673017.839730:0:17166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789673017.839738:0:17166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789673017.839740:0:17166:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789673017.839745:0:17166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789673017.839832:0:17117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789673017.839858:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789673017.839880:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5200/0x6c78c4f8c99661d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99661dd expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673017.839892:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5200/0x6c78c4f8c99661d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99661dd expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789673017.839951:0:17117:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789673017.839954:0:17117:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfc7f765000 10000000:01000000:1.0:1789673017.839958:0:17117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfc7f765000 10000000:01000000:1.0:1789673017.839962:0:17117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789673017.839982:0:17117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfc7f765000 from 1 10000000:01000000:1.0:1789673017.839985:0:17117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789673017.840011:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52434a00/0x6c78c4f8c99661e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673017.840019:0:17117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc52434a00/0x6c78c4f8c99661e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673017.840028:0:17117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc52434a00/0x6c78c4f8c99661e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673017.840040:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738488960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789673017.840067:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673017.840097:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d839180 going to sleep for 11 seconds 00000100:00100000:2.0:1789673017.840293:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738488960 00000100:00100000:2.0:1789673017.840299:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738488960 00000100:00100000:2.0:1789673017.840340:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789673017.840349:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+11:17117:x1876607738488960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789673017.840359:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673017.840376:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb46aef200/0x6c78c4f8c99661eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99661e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673017.840400:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb46aef200/0x6c78c4f8c99661eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99661e4 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673017.840412:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb46aef200/0x6c78c4f8c99661eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99661e4 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673017.840421:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef200, rc 0) 00000100:00100000:2.0:1789673017.840738:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17117:x1876607738488960:12345-0@lo:101:mount.lustre.0 Request processed in 389us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673017.840745:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789673017.843087:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738488960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789673017.843117:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc52434a00/0x6c78c4f8c99661e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99661eb expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673017.843131:0:17117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc52434a00/0x6c78c4f8c99661e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99661eb expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673017.843222:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f649180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738489088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789673017.843282:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673017.843394:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc65c1d300 going to sleep for 11 seconds 00000100:00100000:2.0:1789673017.847564:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738489088 00000100:00100000:2.0:1789673017.847579:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738489088 00000100:00100000:2.0:1789673017.847677:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789673017.847689:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17117:x1876607738489088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789673017.847897:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17117:x1876607738489088:12345-0@lo:501:mount.lustre.0 Request processed in 209us (4614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673017.847906:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789673017.848087:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f649180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738489088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789673017.848142:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f649180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738489216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789673017.848197:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673017.848242:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc65c1d300 going to sleep for 11 seconds 00000100:00100000:2.0:1789673017.848457:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738489216 00000100:00100000:2.0:1789673017.848464:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738489216 00000100:00100000:2.0:1789673017.848497:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789673017.848505:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17117:x1876607738489216:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789673017.848604:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17117:x1876607738489216:12345-0@lo:503:mount.lustre.0 Request processed in 99us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673017.848611:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789673017.848703:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f649180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738489216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789673017.851982:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f714a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17170:1876607738489344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789673017.852068:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673017.852120:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45b99300 going to sleep for 11 seconds 00000100:00100000:3.0:1789673017.853130:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738489344 00000100:00100000:3.0:1789673017.853140:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738489344 00000100:00100000:3.0:1789673017.853199:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789673017.853211:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17170:x1876607738489344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789673017.853399:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17170:x1876607738489344:12345-0@lo:502:llog_process_th.0 Request processed in 191us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673017.853407:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789673017.853609:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f714a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17170:1876607738489344:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789673017.853714:0:17170:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789673017.853731:0:17170:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8cfb477b19c0) 00000020:00000080:2.0:1789673017.853752:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789673017.853875:0:17170:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfc7f765000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789673017.853879:0:17170:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfc7f765000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789673017.853881:0:17170:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfc7f765000 4 00010000:00080000:2.0:1789673017.853914:0:17170:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfb47965000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.150@tcp at head 00010000:00010000:2.0:1789673017.855960:0:17170:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1789673017.856223:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789673017.856272:0:17170:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789673017.856288:0:17170:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6c78c4f8c99661f9 00000100:00080000:2.0:1789673017.856300:0:17170:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789673017.856312:0:17170:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cfb47965000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789673017.856351:0:17170:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7f714a80 x1876607738489472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789673017.856418:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876607738489472:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789673017.856499:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789673017.856575:0:17170:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789673017.857127:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738489472 00000100:00100000:3.0:1789673017.857138:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738489472 00000100:00100000:3.0:1789673017.857174:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789673017.857183:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876607738489472:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789673017.857249:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876607738489472:12345-0@lo:38:llog_process_th.0 Request processed in 66us (750us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789673017.857272:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789673017.857320:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789673017.857327:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb47965000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789673017.857331:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789673017.857336:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876607738489472:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789673017.859995:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17170:1876607738489600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789673017.860082:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673017.860132:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45b99180 going to sleep for 11 seconds 00000100:00100000:1.0:1789673017.860200:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738489600 00000100:00100000:1.0:1789673017.860208:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738489600 00000100:00100000:1.0:1789673017.860268:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789673017.860279:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17170:x1876607738489600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789673017.860425:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17170:x1876607738489600:12345-0@lo:502:llog_process_th.0 Request processed in 148us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673017.860433:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789673017.860619:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17170:1876607738489600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789673017.860767:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17170:1876607738489728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789673017.860808:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673017.860837:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45b99180 going to sleep for 11 seconds 00000100:00100000:2.0:1789673017.860857:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738489728 00000100:00100000:2.0:1789673017.860862:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738489728 00000100:00100000:2.0:1789673017.860896:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789673017.860903:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17170:x1876607738489728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789673017.860995:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17170:x1876607738489728:12345-0@lo:502:llog_process_th.0 Request processed in 92us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673017.861002:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789673017.861042:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17170:1876607738489728:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789673017.861062:0:17170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789673017.865453:0:17117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789673017.865504:0:17117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789673017.865534:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52434a00/0x6c78c4f8c99661e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99661eb expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.865547:0:17117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc52434a00/0x6c78c4f8c99661e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99661eb expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789673017.865627:0:17117:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789673017.865630:0:17117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789673017.865632:0:17117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789673017.865633:0:17117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789673017.865635:0:17117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789673017.865890:0:17117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789673017.865892:0:17117:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789673017.865893:0:17117:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789673017.865902:0:17117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789673017.865903:0:17117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789673017.865907:0:17117:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789673017.865911:0:17117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789673017.865912:0:17117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789673017.865913:0:17117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789673017.865914:0:17117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789673017.865915:0:17117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789673017.865916:0:17117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789673017.865916:0:17117:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789673017.865917:0:17117:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789673017.865918:0:17117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789673017.865919:0:17117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789673017.865946:0:17117:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789673017.865977:0:17117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738489856:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789673017.866053:0:17117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673017.866135:0:17117:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc499ea600 going to sleep for 11 seconds 00000100:00100000:2.0:1789673017.874894:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738489856 00000100:00100000:2.0:1789673017.874909:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738489856 00000100:00100000:2.0:1789673017.874994:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789673017.875008:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17117:x1876607738489856:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789673017.875059:0:17132:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789673017.875076:0:17132:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789673017.882865:0:17132:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789673017.882883:0:17132:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789673017.882945:0:17154:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789673017.882951:0:17154:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789673017.882994:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966200 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673017.883013:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d8cd400/0x6c78c4f8c99661cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99661c8 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673017.883033:0:17154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966200 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673017.883074:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d8cd400/0x6c78c4f8c99661cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c99661c8 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673017.883090:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfc7d8cd400/0x6c78c4f8c99661cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c99661c8 expref: 12 pid: 17131 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673017.883106:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876607738489984:0@lo:104: 00000100:00100000:0.0:1789673017.883173:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17117:x1876607738489856:12345-0@lo:253:mount.lustre.0 Request processed in 8167us (17117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673017.883183:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789673017.883256:0:17117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17117:1876607738489856:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789673017.883269:0:17117:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789673017.883272:0:17117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789673017.883273:0:17117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789673017.883275:0:17117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789673017.883276:0:17117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789673017.883277:0:17117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789673017.883278:0:17117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789673017.883279:0:17117:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789673017.883280:0:17117:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789673017.883281:0:17117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789673017.883282:0:17117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789673017.883293:0:17117:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789673017.883336:0:17154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673017.883385:0:17154:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4a65b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789673017.883400:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738489984 00000100:00100000:0.0:1789673017.883406:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738489984 00000100:00100000:0.0:1789673017.883441:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789673017.883447:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+3:17154:x1876607738489984:12345-0@lo:104: 00010000:00010000:0.0:1789673017.883458:0:17121:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc52434800/0x6c78c4f8c99661c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99661cf expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.883504:0:17121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789673017.883509:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+3:17154:x1876607738489984:12345-0@lo:104: Request processed in 63us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673017.883513:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789673017.883540:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876607738489984:0@lo:104: 00010000:00010000:0.0:1789673017.883551:0:17154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966200 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884206:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789673017.884213:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc52434800/0x6c78c4f8c99661c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99661cf expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884220:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434800 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789673017.884223:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52434800/0x6c78c4f8c99661c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c99661cf expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884230:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc52434800/0x6c78c4f8c99661c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c99661cf expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789673017.884236:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52434800/0x6c78c4f8c99661c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c99661cf expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789673017.884242:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789673017.884280:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc52434800/0x6c78c4f8c99661c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99661cf expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884287:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789673017.884312:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc52434800/0x6c78c4f8c99661c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99661cf expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884319:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc52434800/0x6c78c4f8c99661c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99661cf expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884335:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673017.884338:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673017.884349:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673017.884386:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738490112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789673017.884426:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673017.884535:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738490112 00000100:00100000:0.0:1789673017.884540:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738490112 00010000:00010000:0.0:1789673017.884558:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d8cd400/0x6c78c4f8c99661cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99661c8 expref: 12 pid: 17131 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673017.884584:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789673017.884590:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:3637:x1876607738490112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789673017.884598:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789673017.884602:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d8cd400/0x6c78c4f8c99661cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99661c8 expref: 12 pid: 17131 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884609:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d8cd400/0x6c78c4f8c99661cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c99661c8 expref: 12 pid: 17131 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884618:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8cd400/0x6c78c4f8c99661cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c99661c8 expref: 12 pid: 17131 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884628:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966200 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884634:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966200 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789673017.884644:0:17123:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001694491s 00010000:00010000:0.0:1789673017.884647:0:17123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966200 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884652:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966200 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884674:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966200 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884679:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966200 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884683:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4e00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789673017.884685:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966200 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884690:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966200 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884699:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966200 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884706:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789673017.884734:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+11:3637:x1876607738490112:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673017.884742:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789673017.884768:0:17154:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966200 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884774:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966200 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673017.884778:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966200 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673017.884798:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738490112:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1789673017.905168:0:17117:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1789673017.905484:0:17117:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789673017.905536:0:17178:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789673017.905539:0:17178:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789673017.905808:0:17179:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789673017.905890:0:17117:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1789673017.906222:0:17179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1789673017.906265:0:17180:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8cfc462dca80 x1876607738490240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789673017.906278:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00000040:01000000:1.0:1789673017.906533:0:17117:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789673017.906559:0:17117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789673017.907626:0:17117:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789673017.907680:0:17117:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789673017.907745:0:17117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789673017.908578:0:17117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789673017.908983:0:17117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789673017.909005:0:17117:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1789673017.910107:0:17117:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1789673017.911879:0:17117:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789673017.913011:0:17117:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789673017.913056:0:17117:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac6d81a63988 00100000:10000000:1.0:1789673017.913064:0:17117:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789673017.916158:0:17117:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789673017.916180:0:17117:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789673017.916200:0:17117:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789673017.916229:0:17117:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789673017.917110:0:17117:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789673017.917341:0:17117:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1789673017.922088:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789673017.933424:0:17179:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00010000:00010000:1.0:1789673018.438401:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789673018.500893:0:17135:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789673018.500902:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfc7f765000 from 7 10000000:01000000:0.0:1789673018.500908:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789673018.500974:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673018.500987:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673018.500999:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673018.501033:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738490368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789673018.501101:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673018.501148:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7f6069c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789673018.501751:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738490368 00000100:00100000:2.0:1789673018.501759:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738490368 00000100:00100000:2.0:1789673018.501808:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789673018.501816:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+11:17135:x1876607738490368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789673018.501827:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673018.501842:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c996620e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9966207 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673018.501862:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c996620e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9966207 expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673018.501870:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c996620e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9966207 expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673018.501876:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee000, rc 0) 00000100:00100000:2.0:1789673018.501912:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17135:x1876607738490368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673018.501917:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789673018.502122:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738490368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789673018.502140:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996620e expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673018.502170:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996620e expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673018.502225:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738490496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789673018.503899:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673018.503947:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7f6069c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789673018.504154:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738490496 00000100:00100000:2.0:1789673018.504162:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738490496 00000100:00100000:2.0:1789673018.504195:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789673018.504201:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17135:x1876607738490496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789673018.504218:0:17132:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789673018.504244:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789673018.504247:0:17132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789673018.504342:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17135:x1876607738490496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673018.504348:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789673018.504410:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738490496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789673018.504451:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789673018.504459:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966207 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996620e expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673018.504467:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996620e expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789673018.884602:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789673018.948137:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00010000:00010000:2.0:1789673019.462731:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789673019.916920:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789673019.971799:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00010000:00010000:2.0:1789673020.505287:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673020.995782:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00010000:00010000:2.0:1789673021.509425:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673022.024041:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00010000:00010000:1.0:1789673022.536947:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673023.046645:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00000100:00080000:3.0:1789673023.302820:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789673023.302827:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789673023.302830:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c3000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789673023.302839:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:3.0:1789673023.302844:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789673023.302856:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cfc458c3000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789673023.302891:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7f649500 x1876607738490752/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789673023.302907:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789673023.302910:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789673023.302913:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789673023.302916:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789673023.302919:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789673023.302934:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789673023.302936:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfb47965000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789673023.302942:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cfb47965000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789673023.302960:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7f648a80 x1876607738490880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789673023.302988:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789673023.303005:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738490624:0@lo:400:kworker.0 00000100:00100000:3.0:1789673023.303083:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673023.303154:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738490624 00000100:00100000:3.0:1789673023.303162:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738490624 00000100:00100000:3.0:1789673023.303212:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789673023.303221:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:3637:x1876607738490624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673023.303268:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:3637:x1876607738490624:12345-0@lo:400:kworker.0 Request processed in 49us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673023.303275:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789673023.303313:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738490752:0@lo:38:kworker.0 00000100:00100000:3.0:1789673023.303338:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673023.303361:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876607738490880:0@lo:38:kworker.0 00000100:00100000:3.0:1789673023.303383:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673023.303444:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738490752 00000100:00100000:3.0:1789673023.303450:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738490752 00000100:00100000:3.0:1789673023.303482:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789673023.303488:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1876607738490752:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789673023.303518:0:17144:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789673023.309810:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738490880 00000100:00100000:1.0:1789673023.309833:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738490880 00000100:00100000:1.0:1789673023.309905:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789673023.309917:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1876607738490880:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789673023.309956:0:17140:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:1.0:1789673023.310007:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6c78c4f8c9966215 00000004:00100000:1.0:1789673023.310028:0:17140:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789673023.310226:0:17140:0:(import.c:65:import_set_state_nolock()) ffff8cfc499ae800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789673023.310633:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1876607738490880:12345-0@lo:38:kworker.0 Request processed in 716us (7246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673023.310642:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789673023.318046:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738490624:0@lo:400:kworker.0 00010000:00080000:2.0:1789673023.320037:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfc7f648a80 x1876607738490880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789673033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789673023.320060:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789673023.320070:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789673023.320075:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789673023.320078:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb47965000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789673023.320086:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1876607738490880:0@lo:38:kworker.0 00000100:00100000:2.0:1789673023.352675:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1876607738490752:12345-0@lo:38:kworker.0 Request processed in 49161us (49310us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789673023.352708:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789673023.352776:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c3000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789673023.352783:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789673023.352787:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738490752:0@lo:38:kworker.0 00010000:00010000:2.0:1789673023.556737:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673024.067906:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00000001:02000400:3.0:1789673024.579532:0:17423:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789673024.600597:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673025.091875:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00010000:00010000:2.0:1789673025.608440:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789673025.755428:0:17476:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789673025.755621:0:17476:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789673026.115777:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00000020:00000004:0.0:1789673026.623966:0:17526:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789673026.624169:0:17526:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789673026.630046:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673027.141732:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00000100:00100000:3.0:1789673027.395997:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789673017/real 1789673017] req@ffff8cfc462ddf80 x1876607738487808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673027 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673027.396034:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfc462ddf80 x1876607738487808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673027 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673027.396045:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789673017/real 1789673017] req@ffff8cfc7d8dc380 x1876607738487680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673027 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673027.396058:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfc7d8dc380 x1876607738487680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673027 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789673027.396079:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789673027.396091:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789673027.396096:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738487808:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789673027.396107:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb4693c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789673027.396114:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789673027.396117:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738487680:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789673027.398637:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789673027.398646:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789673027.398649:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c3000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789673027.398672:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 501 00000100:00080000:1.0:1789673027.398679:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789673027.398692:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cfc458c3000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789673027.398720:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d8dc380 x1876607738491136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789673027.398747:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673027.398750:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789673027.398752:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfb4693c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789673027.398756:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:1.0:1789673027.398760:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789673027.398765:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cfb4693c000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789673027.398777:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d8de680 x1876607738491264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789673027.398785:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673027.398788:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789673027.398789:0:37:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789673027.398792:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:1.0:1789673027.398806:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789673027.398811:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfc458c7800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789673027.398821:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d8dd180 x1876607738491392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789673027.398883:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3635:1876607738491008:0@lo:400:kworker.0 00000100:00100000:1.0:1789673027.398981:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673027.399035:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789673027.399041:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738491520:0@lo:400:kworker.0 00000100:00100000:1.0:1789673027.399074:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673027.399135:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738491520 00000100:00100000:1.0:1789673027.399144:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738491520 00000100:00100000:1.0:1789673027.399191:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789673027.399208:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738491520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673027.399439:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738491008 00000100:00100000:3.0:1789673027.399446:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738491008 00000100:00100000:1.0:1789673027.399488:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738491520:12345-0@lo:400:kworker.0 Request processed in 280us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673027.399495:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789673027.399500:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789673027.399507:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:3635:x1876607738491008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673027.399550:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:3635:x1876607738491008:12345-0@lo:400:kworker.0 Request processed in 46us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673027.399556:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789673027.399588:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738491136:0@lo:38:kworker.0 00010000:00080000:0.0:1789673027.399630:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfc7d8de300 x1876607738491520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673027.399633:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673027.399680:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738491520:0@lo:400:kworker.0 00000100:00100000:0.0:1789673027.399695:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3635:1876607738491008:0@lo:400:kworker.0 00000100:00100000:3.0:1789673027.399726:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738491264:0@lo:8:kworker.0 00000400:00000100:3.0:1789673027.399748:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876607738491264 offset 0 length 520: 4 00000100:00100000:3.0:1789673027.399761:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738491392:0@lo:8:kworker.0 00000400:00000100:3.0:1789673027.399773:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876607738491392 offset 0 length 520: 4 00000100:00100000:1.0:1789673027.400296:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738491136 00000100:00100000:1.0:1789673027.400304:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738491136 00000100:00100000:1.0:1789673027.400337:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789673027.400344:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876607738491136:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789673027.400364:0:17143:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789673027.462724:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876607738491136:12345-0@lo:38:kworker.0 Request processed in 62370us (63083us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789673027.462747:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789673027.463066:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c3000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789673027.463088:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789673027.463106:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738491136:0@lo:38:kworker.0 00010000:00010000:0.0:1789673027.652783:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673028.163709:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00010000:00010000:1.0:1789673028.676017:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789673029.128915:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789673029.192470:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00010000:00010000:0.0:1789673029.703122:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789673030.213911:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00010000:00010000:1.0:1789673030.724009:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673031.238528:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00010000:00010000:0.0:1789673031.753877:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789673032.263776:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00000100:00080000:3.0:1789673032.526035:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789673032.526043:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789673032.526047:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c3000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789673032.526056:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 505 00000100:00080000:3.0:1789673032.526063:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789673032.526077:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cfc458c3000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789673032.526104:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7f64b100 x1876607738491776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789673032.526123:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789673032.526127:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789673032.526129:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789673032.526132:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789673032.526188:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738491904:0@lo:400:kworker.0 00000100:00100000:3.0:1789673032.526262:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673032.526328:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789673032.526334:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3638:1876607738491648:0@lo:400:kworker.0 00000100:00100000:3.0:1789673032.526380:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673032.526418:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738491904 00000100:00100000:3.0:1789673032.526426:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738491904 00000100:00100000:3.0:1789673032.526472:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789673032.526480:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738491904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673032.526539:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738491904:12345-0@lo:400:kworker.0 Request processed in 47us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673032.526547:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789673032.526571:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738491648 00000100:00100000:3.0:1789673032.526574:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738491648 00000100:00100000:3.0:1789673032.526600:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789673032.526606:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:3638:x1876607738491648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673032.526636:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:3638:x1876607738491648:12345-0@lo:400:kworker.0 Request processed in 30us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673032.526642:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789673032.526729:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3638:1876607738491648:0@lo:400:kworker.0 00010000:00080000:3.0:1789673032.526743:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfc7f64aa00 x1876607738491904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673032.526754:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738491904:0@lo:400:kworker.0 00000100:00100000:3.0:1789673032.526783:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738491776:0@lo:38:kworker.0 00000100:00100000:3.0:1789673032.526812:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673032.528122:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738491776 00000100:00100000:3.0:1789673032.528131:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738491776 00000100:00100000:3.0:1789673032.528162:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789673032.528170:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1876607738491776:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789673032.528200:0:17144:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789673032.553473:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1876607738491776:12345-0@lo:38:kworker.0 Request processed in 25298us (26654us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789673032.553486:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789673032.556424:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c3000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789673032.556435:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789673032.556439:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738491776:0@lo:38:kworker.0 00010000:00010000:0.0:1789673032.772814:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789673033.283786:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00010000:00010000:0.0:1789673033.796241:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673034.311423:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00010000:00010000:0.0:1789673034.825619:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789673034.919145:0:17871:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789673034.919771:0:17871:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789673034.919773:0:17871:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789673034.920319:0:17871:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cfb46b12800 00000020:01000004:1.0:1789673034.920338:0:17871:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1789673034.920351:0:17871:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789673034.920379:0:17871:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8cfc497b8000) 00000020:00000080:1.0:1789673034.920398:0:17871:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789673035.065727:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789673035.066283:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.067894:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1789673035.068433:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789673035.069275:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789673035.069514:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.069820:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.070064:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1789673035.070316:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789673035.070595:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.070907:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.071214:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1789673035.071459:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.071981:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1789673035.072245:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789673035.072439:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789673035.072726:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.072926:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.073110:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.073293:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789673035.073575:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.074035:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.074456:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789673035.074842:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789673035.075090:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.075627:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.076023:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.076257:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789673035.076547:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1789673035.076943:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.077915:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.078388:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789673035.078651:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789673035.079050:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1789673035.079430:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1789673035.079977:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1789673035.080245:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789673035.080558:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789673035.080877:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789673035.081099:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789673035.081618:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789673035.082115:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1789673035.082370:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1789673035.082649:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789673035.082984:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1789673035.083218:0:17871:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:01000000:2.0:1789673035.091004:0:17871:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789673035.091248:0:17871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789673035.091260:0:17871:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789673035.091276:0:17871:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c78c4f8c9966223 00000020:01000004:2.0:1789673035.091284:0:17871:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789673035.091308:0:17871:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.150@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789673035.091312:0:17871:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789673035.091317:0:17871:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789673035.091348:0:17871:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789673035.091352:0:17871:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789673035.097227:0:17871:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789673035.097275:0:17871:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.150@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789673035.097279:0:17871:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789673035.097281:0:17871:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789673035.097283:0:17871:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789673035.097285:0:17871:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789673035.097286:0:17871:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789673035.097288:0:17871:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789673035.097289:0:17871:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789673035.097291:0:17871:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789673035.097292:0:17871:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789673035.097296:0:17871:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789673035.097298:0:17871:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789673035.097300:0:17871:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789673035.097301:0:17871:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789673035.097302:0:17871:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789673035.097303:0:17871:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789673035.097305:0:17871:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789673035.097306:0:17871:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789673035.097307:0:17871:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789673035.097308:0:17871:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789673035.097336:0:17871:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789673035.097357:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738492032:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789673035.098212:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.098333:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc65c1df00 going to sleep for 11 seconds 00000100:00100000:0.0:1789673035.102230:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738492032 00000100:00100000:0.0:1789673035.102244:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738492032 00000100:00100000:0.0:1789673035.102320:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789673035.102331:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17871:x1876607738492032:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789673035.102377:0:17131:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789673035.102380:0:17131:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1789673035.102390:0:17131:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789673035.102997:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17871:x1876607738492032:12345-0@lo:253:mount.lustre.0 Request processed in 667us (5552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673035.103007:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789673035.103132:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738492032:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789673035.103150:0:17871:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789673035.103153:0:17871:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789673035.103155:0:17871:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789673035.103157:0:17871:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789673035.103158:0:17871:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789673035.103159:0:17871:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789673035.103161:0:17871:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789673035.103162:0:17871:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789673035.103164:0:17871:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789673035.103165:0:17871:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789673035.103189:0:17871:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfb46b12800 from lustre-MDT0001 10000000:01000000:2.0:1789673035.103231:0:17871:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789673035.103234:0:17871:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789673035.103241:0:17871:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cfb477b0000 local copy 00010000:00010000:2.0:1789673035.103253:0:17871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cc600/0x6c78c4f8c9966119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966120 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673035.103359:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738492160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789673035.103395:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.103438:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789673035.103551:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738492160 00000100:00100000:3.0:1789673035.103557:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738492160 00000100:00100000:3.0:1789673035.103600:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789673035.103609:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17871:x1876607738492160:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789673035.103713:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17871:x1876607738492160:12345-0@lo:501:mount.lustre.0 Request processed in 105us (316us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789673035.103721:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789673035.103899:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738492160:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789673035.103913:0:17871:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789673035.103930:0:17871:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789673035.103936:0:17871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cc600/0x6c78c4f8c9966119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966120 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.103946:0:17871:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cc600/0x6c78c4f8c9966119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966120 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789673035.103982:0:17871:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfb46b12800 10000000:01000000:2.0:1789673035.103987:0:17871:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789673035.103992:0:17871:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cfb477b0000 10000000:01000000:2.0:1789673035.103995:0:17871:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789673035.103998:0:17871:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cfb477b0000 from 1 10000000:01000000:2.0:1789673035.104002:0:17871:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789673035.104027:0:17871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb46aeea00/0x6c78c4f8c996622a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.104036:0:17871:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfb46aeea00/0x6c78c4f8c996622a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.104046:0:17871:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfb46aeea00/0x6c78c4f8c996622a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673035.104061:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738492288:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789673035.104087:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.104115:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3780 going to sleep for 11 seconds 00000100:00100000:0.0:1789673035.104164:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738492288 00000100:00100000:0.0:1789673035.104169:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738492288 00000100:00100000:0.0:1789673035.104203:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789673035.104210:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+12:17871:x1876607738492288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789673035.104220:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673035.104233:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8ccc00/0x6c78c4f8c9966231 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c996622a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.104253:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8ccc00/0x6c78c4f8c9966231 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c996622a expref: 13 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.104264:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8ccc00/0x6c78c4f8c9966231 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c996622a expref: 13 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.104273:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8ccc00, rc 0) 00000100:00100000:0.0:1789673035.104310:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+13:17871:x1876607738492288:12345-0@lo:101:mount.lustre.0 Request processed in 101us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673035.104317:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789673035.104382:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738492288:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789673035.104394:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfb46aeea00/0x6c78c4f8c996622a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966231 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.104404:0:17871:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfb46aeea00/0x6c78c4f8c996622a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9966231 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789673035.104419:0:17871:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789673035.104434:0:17871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb46aeea00/0x6c78c4f8c996622a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966231 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.104465:0:17871:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfb46aeea00/0x6c78c4f8c996622a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966231 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789673035.104473:0:17871:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cfb46b12800 10000000:01000000:2.0:1789673035.104476:0:17871:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789673035.104479:0:17871:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cfb46b12800 from 1 10000000:01000000:2.0:1789673035.104482:0:17871:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789673035.104495:0:17871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef000/0x6c78c4f8c9966238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.104502:0:17871:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef000/0x6c78c4f8c9966238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.104509:0:17871:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef000/0x6c78c4f8c9966238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673035.104520:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738492416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789673035.104545:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.104571:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3780 going to sleep for 11 seconds 00000100:00100000:1.0:1789673035.104700:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738492416 00000100:00100000:1.0:1789673035.104706:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738492416 00000100:00100000:1.0:1789673035.104737:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789673035.104745:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+13:17871:x1876607738492416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789673035.104752:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789673035.104761:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c996623f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9966238 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673035.104778:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c996623f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9966238 expref: 14 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673035.104787:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52435000/0x6c78c4f8c996623f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9966238 expref: 14 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673035.104794:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435000, rc 0) 00000100:00100000:1.0:1789673035.104834:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+14:17871:x1876607738492416:12345-0@lo:101:mount.lustre.0 Request processed in 90us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673035.104841:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789673035.105250:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738492416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789673035.105262:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef000/0x6c78c4f8c9966238 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996623f expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.105271:0:17871:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef000/0x6c78c4f8c9966238 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996623f expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789673035.105282:0:17871:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789673035.105298:0:17871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef000/0x6c78c4f8c9966238 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996623f expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.105314:0:17871:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef000/0x6c78c4f8c9966238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996623f expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789673035.105322:0:17871:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789673035.105326:0:17871:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789673035.105330:0:17871:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cfb46b12800 10000000:01000000:2.0:1789673035.105333:0:17871:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789673035.105336:0:17871:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789673035.105338:0:17871:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789673035.105352:0:17871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee400/0x6c78c4f8c9966246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.105360:0:17871:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee400/0x6c78c4f8c9966246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.105368:0:17871:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee400/0x6c78c4f8c9966246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673035.105380:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738492544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789673035.105406:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.105434:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3780 going to sleep for 11 seconds 00000100:00100000:1.0:1789673035.105546:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738492544 00000100:00100000:1.0:1789673035.105557:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738492544 00000100:00100000:1.0:1789673035.105589:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789673035.105596:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+14:17871:x1876607738492544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789673035.105603:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789673035.105610:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52435400/0x6c78c4f8c996624d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9966246 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673035.105624:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52435400/0x6c78c4f8c996624d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9966246 expref: 15 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673035.105633:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52435400/0x6c78c4f8c996624d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9966246 expref: 15 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673035.105641:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435400, rc 0) 00000100:00100000:1.0:1789673035.105703:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+15:17871:x1876607738492544:12345-0@lo:101:mount.lustre.0 Request processed in 107us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673035.105710:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789673035.105909:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738492544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789673035.105921:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee400/0x6c78c4f8c9966246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996624d expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.105929:0:17871:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee400/0x6c78c4f8c9966246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996624d expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789673035.107334:0:17871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1789673035.108211:0:17871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789673035.108465:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789673035.108491:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1789673035.108508:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1789673035.108521:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1789673035.108536:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1789673035.108551:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1789673035.108565:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1789673035.108578:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1789673035.108589:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1789673035.108602:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1789673035.108614:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1789673035.108626:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1789673035.108638:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1789673035.108654:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1789673035.108706:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1789673035.108723:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1789673035.108734:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1789673035.108745:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1789673035.108760:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1789673035.108775:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1789673035.108787:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1789673035.108912:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1789673035.108931:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1789673035.108949:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1789673035.108954:0:17871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1789673035.109038:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738492672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789673035.109103:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.109143:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789673035.109240:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738492672 00000100:00100000:0.0:1789673035.109248:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738492672 00000100:00100000:0.0:1789673035.109300:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789673035.109309:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+15:17871:x1876607738492672:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789673035.109464:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+15:17871:x1876607738492672:12345-0@lo:501:mount.lustre.0 Request processed in 155us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673035.109472:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789673035.109714:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738492672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789673035.109747:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738492800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789673035.109788:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.109943:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789673035.113090:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738492800 00000100:00100000:3.0:1789673035.113105:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738492800 00000100:00100000:3.0:1789673035.113177:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789673035.113187:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+15:17871:x1876607738492800:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789673035.114636:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+15:17871:x1876607738492800:12345-0@lo:503:mount.lustre.0 Request processed in 1445us (4842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673035.114648:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789673035.114793:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738492800:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789673035.115255:0:17871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789673035.115337:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738492928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673035.115388:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.115431:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3780 going to sleep for 11 seconds 00000100:00100000:0.0:1789673035.115609:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738492928 00000100:00100000:0.0:1789673035.115616:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738492928 00000100:00100000:0.0:1789673035.115685:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789673035.115695:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+15:17871:x1876607738492928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789673035.116352:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+15:17871:x1876607738492928:12345-0@lo:502:mount.lustre.0 Request processed in 657us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673035.116361:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789673035.116650:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738492928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789673035.116885:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789673035.116915:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1789673035.116927:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1789673035.116941:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1789673035.116954:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1789673035.116965:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1789673035.116977:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1789673035.116989:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1789673035.117000:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1789673035.117010:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1789673035.117025:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1789673035.117039:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1789673035.117050:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1789673035.117063:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1789673035.117075:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1789673035.117089:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1789673035.117102:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1789673035.117115:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1789673035.117140:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1789673035.117154:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1789673035.117167:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1789673035.117182:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1789673035.117195:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1789673035.117208:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1789673035.117220:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1789673035.117232:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1789673035.117243:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1789673035.117256:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1789673035.117268:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1789673035.117280:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1789673035.117294:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1789673035.117307:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1789673035.117319:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1789673035.117335:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1789673035.117347:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1789673035.117359:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1789673035.117372:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1789673035.117386:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1789673035.117399:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1789673035.117413:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1789673035.117426:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1789673035.117439:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1789673035.117451:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1789673035.117464:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1789673035.117499:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738493056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673035.117553:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.117580:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3780 going to sleep for 11 seconds 00000100:00100000:0.0:1789673035.117844:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738493056 00000100:00100000:0.0:1789673035.117851:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738493056 00000100:00100000:0.0:1789673035.117887:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789673035.117895:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+15:17871:x1876607738493056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789673035.118000:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+15:17871:x1876607738493056:12345-0@lo:502:mount.lustre.0 Request processed in 105us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673035.118008:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789673035.118285:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738493056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789673035.118335:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1789673035.118351:0:17871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1789673035.122066:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789673035.122082:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789673035.122086:0:17875:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789673035.122094:0:17875:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789673035.122096:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789673035.122117:0:17875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8cfb467719c0) 00000020:00000080:3.0:1789673035.122150:0:17875:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1789673035.122157:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789673035.122272:0:17875:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789673035.122280:0:17875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c78c4f8c996625b 00000020:00000080:3.0:1789673035.124906:0:17875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789673035.124921:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789673035.124940:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789673035.124943:0:17875:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789673035.124948:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789673035.124953:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789673035.124955:0:17875:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789673035.124959:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789673035.124975:0:17875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8cfb46774d40) 00000020:00000080:3.0:1789673035.125001:0:17875:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1789673035.125006:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789673035.125008:0:17875:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789673035.125011:0:17875:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789673035.125018:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789673035.125104:0:17875:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfb46b12800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789673035.125118:0:17875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8cfb46770000) 00000020:00000080:3.0:1789673035.125128:0:17875:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1789673035.125192:0:17875:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789673035.125200:0:17875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c78c4f8c9966270 00000020:00000080:3.0:1789673035.125321:0:17875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789673035.125328:0:17875:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789673035.125333:0:17875:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x6c78c4f8c9966277 00080000:01000000:3.0:1789673035.125339:0:17875:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789673035.125343:0:17875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c78c4f8c996627e 00010000:00010000:2.0:1789673035.256587:0:17875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789673035.257651:0:17875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1789673035.259994:0:17875:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789673035.266060:0:17875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789673035.266080:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789673035.266090:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673035.266093:0:17875:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789673035.266107:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789673035.266114:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673035.266116:0:17875:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789673035.266120:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789673035.266126:0:17875:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:00000080:0.0:1789673035.266157:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789673035.266175:0:17875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8cfc815d8000) 00000020:00000080:0.0:1789673035.266200:0:17875:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1789673035.266222:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789673035.266309:0:17875:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789673035.266316:0:17875:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789673035.266323:0:17875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c78c4f8c996628c 00010000:00080000:0.0:1789673035.266355:0:17875:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfc4420c800@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:0.0:1789673035.273149:0:17875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1789673035.278091:0:17875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789673035.278119:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789673035.278162:0:17875:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789673035.283280:0:17875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c78c4f8c9966293 00000100:00080000:1.0:1789673035.283306:0:17875:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789673035.283322:0:17875:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8cfc4420c800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789673035.283375:0:17875:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d8df100 x1876607738493184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789673035.283415:0:17875:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789673035.283546:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789673035.283553:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673035.283556:0:17875:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789673035.283576:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789673035.283579:0:17875:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789673035.283582:0:17875:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789673035.283583:0:17875:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789673035.283585:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789673035.283588:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673035.283589:0:17875:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789673035.283592:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789673035.283598:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673035.283599:0:17875:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789673035.283603:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789673035.283695:0:17875:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789673035.283711:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789673035.283715:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673035.283716:0:17875:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789673035.283720:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789673035.283722:0:17875:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1789673035.283723:0:17875:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789673035.283725:0:17875:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789673035.283727:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789673035.283730:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673035.283732:0:17875:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789673035.283734:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789673035.283738:0:17875:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789673035.283741:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673035.283743:0:17875:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789673035.283746:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789673035.283749:0:17875:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:1.0:1789673035.283772:0:17875:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789673035.283775:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:3.0:1789673035.284117:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738493184:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789673035.284197:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673035.284288:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738493184 00000100:00100000:3.0:1789673035.284297:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738493184 00000100:00100000:3.0:1789673035.284331:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789673035.284339:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876607738493184:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789673035.284365:0:17143:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:3.0:1789673035.284407:0:17143:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c78c4f8c996629a 00000004:00100000:3.0:1789673035.284424:0:17143:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789673035.284450:0:17143:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000020:00000080:1.0:1789673035.285118:0:17875:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8cfc497b99c0) 00000020:00000080:1.0:1789673035.285141:0:17875:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789673035.285156:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789673035.285255:0:17875:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789673035.285262:0:17875:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789673035.285269:0:17875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c78c4f8c99662a8 00010000:00080000:1.0:1789673035.285302:0:17875:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfc44208800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:1.0:1789673035.285781:0:17875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:1.0:1789673035.287075:0:17875:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789673035.287286:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1789673035.288642:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789673035.288651:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000040:00080000:1.0:1789673035.293243:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789673035.293652:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00080000:0.0:1789673035.293929:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c3000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789673035.293941:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 510 00000100:00080000:0.0:1789673035.293946:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789673035.293960:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cfc458c3000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789673035.293999:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc462dd500 x1876607738493312/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789673035.294033:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789673035.294038:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789673035.294041:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789673035.294045:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789673035.294117:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738493440:0@lo:400:kworker.0 00000100:00100000:0.0:1789673035.294185:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673035.294255:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738493440 00000100:00100000:0.0:1789673035.294263:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738493440 00000100:00100000:0.0:1789673035.294309:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789673035.294318:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738493440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673035.294370:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738493440:12345-0@lo:400:kworker.0 Request processed in 53us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673035.294387:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789673035.294426:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfc462ddc00 x1876607738493440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000040:00080000:1.0:1789673035.294686:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:0.0:1789673035.294766:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738493440:0@lo:400:kworker.0 00000040:00080000:1.0:1789673035.300605:0:17880:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789673035.300612:0:17880:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1789673035.303410:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738493312:0@lo:38:kworker.0 00000100:00100000:3.0:1789673035.303524:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673035.307431:0:17144:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789673035.307448:0:17144:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000020:00000080:0.0:1789673035.308138:0:17875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789673035.308158:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789673035.308219:0:17875:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789673035.308247:0:17875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c78c4f8c99662af 00000100:00080000:0.0:1789673035.308261:0:17875:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789673035.308273:0:17875:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cfc44208800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789673035.308312:0:17875:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc462ddc00 x1876607738493568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789673035.308348:0:17875:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789673035.308382:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789673035.308387:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789673035.308390:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789673035.308392:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1789673035.308453:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789673035.308458:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673035.308460:0:17875:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789673035.308463:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789673035.308466:0:17875:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1789673035.308468:0:17875:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789673035.308469:0:17875:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789673035.308471:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789673035.308473:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1789673035.308719:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738493568:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789673035.308780:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876607738493568 offset 0 length 520: 4 00000020:00000080:0.0:1789673035.308949:0:17875:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789673035.308955:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789673035.308960:0:17875:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789673035.308964:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673035.308966:0:17875:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789673035.308969:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789673035.308973:0:17875:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.150@tcp to nid 0x20000c0a8c996 (192.168.201.150@tcp) 00000020:01000000:0.0:1789673035.308995:0:17875:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789673035.308998:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789673035.309013:0:17875:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8cfc815d99c0) 00000020:00000080:0.0:1789673035.309030:0:17875:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1789673035.309035:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789673035.309361:0:17875:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789673035.309370:0:17875:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789673035.309380:0:17875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x6c78c4f8c99662bd 00010000:00080000:0.0:1789673035.309412:0:17875:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfc6173d000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:0.0:1789673035.314416:0:17875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1789673035.314640:0:17875:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789673035.314694:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1789673035.314946:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738493312 00000100:00100000:1.0:1789673035.314959:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738493312 00000100:00100000:3.0:1789673035.317116:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789673035.317130:0:17882:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1876607738493312:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789673035.317251:0:17882:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1876607738493312:12345-0@lo:38:kworker.0 Request processed in 122us (13727us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789673035.317259:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789673035.317337:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789673035.317346:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c3000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789673035.317350:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789673035.317355:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738493312:0@lo:38:kworker.0 00000100:00080000:2.0:1789673035.319374:0:17143:0:(import.c:65:import_set_state_nolock()) ffff8cfc49189000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789673035.319646:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789673035.319687:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789673035.319697:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789673035.319702:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789673035.319705:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc4420c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789673035.319726:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738493184:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789673035.319807:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1876607738493184:12345-0@lo:38:llog_process_th.0 Request processed in 35146us (35289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673035.319818:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789673035.320852:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789673035.320872:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738493696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789673035.320938:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789673035.321833:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789673035.322383:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738493696 00000100:00100000:3.0:1789673035.322394:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738493696 00000100:00100000:3.0:1789673035.322455:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789673035.322466:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3635:x1876607738493696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789673035.322577:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789673035.322695:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3635:x1876607738493696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 232us (1757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673035.322703:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789673035.323820:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738493696:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789673035.325147:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789673035.325382:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789673035.326690:0:17883:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789673035.326697:0:17883:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789673035.327454:0:17875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789673035.327467:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789673035.327765:0:17875:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789673035.327791:0:17875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c78c4f8c99662c4 00000100:00080000:3.0:1789673035.328160:0:17875:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789673035.328173:0:17875:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cfc6173d000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789673035.328212:0:17875:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7f648700 x1876607738493824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789673035.328294:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738493824:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789673035.328354:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876607738493824 offset 0 length 520: 4 00000100:00080000:3.0:1789673035.328417:0:17875:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789673035.328509:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789673035.328513:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789673035.328516:0:17875:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789673035.328518:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789673035.328522:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789673035.328524:0:17875:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789673035.328527:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789673035.328529:0:17875:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789673035.328531:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789673035.328534:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789673035.328536:0:17875:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789673035.328538:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789673035.328541:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789673035.328542:0:17875:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789673035.328545:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789673035.328575:0:17875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789673035.328578:0:17875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789673035.328579:0:17875:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789673035.328583:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1789673035.331244:0:17871:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1789673035.331300:0:17871:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789673035.331344:0:17871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee400/0x6c78c4f8c9966246 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996624d expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.331359:0:17871:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee400/0x6c78c4f8c9966246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996624d expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789673035.331370:0:17871:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfb46b12800 from 1 10000000:01000000:2.0:1789673035.331373:0:17871:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789673035.331420:0:17871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99662cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.331429:0:17871:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99662cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.331442:0:17871:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99662cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673035.331506:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f716300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738493952:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789673035.331585:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.331632:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3900 going to sleep for 11 seconds 00000100:00100000:2.0:1789673035.331708:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738493952 00000100:00100000:2.0:1789673035.331716:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738493952 00000100:00100000:2.0:1789673035.331772:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789673035.331782:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+15:17871:x1876607738493952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789673035.331805:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673035.331818:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb46aee800/0x6c78c4f8c99662d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99662cb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.331841:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb46aee800/0x6c78c4f8c99662d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99662cb expref: 16 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.331853:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb46aee800/0x6c78c4f8c99662d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99662cb expref: 16 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.331860:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee800, rc 0) 00000100:00100000:2.0:1789673035.331897:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+16:17871:x1876607738493952:12345-0@lo:101:mount.lustre.0 Request processed in 117us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673035.331904:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789673035.331960:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f716300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738493952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789673035.331975:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99662cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99662d2 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.331984:0:17871:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99662cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99662d2 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673035.332565:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f716300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738494080:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789673035.332604:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.332632:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3900 going to sleep for 11 seconds 00000100:00080000:0.0:1789673035.333171:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789673035.333177:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789673035.333180:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789673035.333183:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789673035.333385:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00000100:00100000:2.0:1789673035.334782:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738494080 00000100:00100000:2.0:1789673035.334871:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738494080 00000100:00100000:2.0:1789673035.334943:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789673035.334954:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+16:17871:x1876607738494080:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789673035.334978:0:17132:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789673035.335003:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789673035.335007:0:17132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789673035.336965:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+16:17871:x1876607738494080:12345-0@lo:256:mount.lustre.0 Request processed in 2004us (4350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673035.336981:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789673035.341447:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f716300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738494080:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789673035.343398:0:17871:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789673035.343428:0:17871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99662cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99662d2 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.343450:0:17871:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99662cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99662d2 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789673035.343458:0:17871:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfb46b12800 from 1 10000000:01000000:2.0:1789673035.343460:0:17871:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789673035.343602:0:17871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee200/0x6c78c4f8c99662d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.343611:0:17871:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee200/0x6c78c4f8c99662d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.343633:0:17871:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee200/0x6c78c4f8c99662d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673035.343700:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f716300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738494208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789673035.343773:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.343888:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789673035.345211:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738494208 00000100:00100000:1.0:1789673035.345222:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738494208 00000100:00100000:1.0:1789673035.345268:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789673035.345277:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4367a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+16:17871:x1876607738494208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789673035.345293:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789673035.345310:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c99662e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99662d9 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673035.345335:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c99662e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99662d9 expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673035.345346:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c99662e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99662d9 expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673035.345355:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434800, rc 0) 00000100:00100000:1.0:1789673035.345423:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4367a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17871:x1876607738494208:12345-0@lo:101:mount.lustre.0 Request processed in 147us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673035.345430:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789673035.345817:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f716300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738494208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789673035.345838:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee200/0x6c78c4f8c99662d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99662e0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.345849:0:17871:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee200/0x6c78c4f8c99662d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99662e0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789673035.345990:0:17871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789673035.346028:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f716300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738494336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789673035.346064:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.346106:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789673035.346302:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738494336 00000100:00100000:0.0:1789673035.346307:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738494336 00000100:00100000:0.0:1789673035.346351:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789673035.346360:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc43678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17871:x1876607738494336:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789673035.346459:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc43678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17871:x1876607738494336:12345-0@lo:501:mount.lustre.0 Request processed in 101us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673035.346584:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789673035.346885:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f716300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738494336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789673035.346914:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f716300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738494464:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789673035.346953:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.347010:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789673035.352722:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738494464 00000100:00100000:3.0:1789673035.352739:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738494464 00000100:00100000:2.0:1789673035.352991:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789673035.353003:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc43679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17871:x1876607738494464:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789673035.353210:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc43679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17871:x1876607738494464:12345-0@lo:503:mount.lustre.0 Request processed in 209us (6255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673035.353226:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789673035.353302:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f716300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738494464:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789673035.353994:0:17871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789673035.354371:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f716300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738494592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673035.354436:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.355243:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789673035.355594:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738494592 00000100:00100000:1.0:1789673035.355602:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738494592 00000100:00100000:1.0:1789673035.355760:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789673035.355773:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4367b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17871:x1876607738494592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789673035.356060:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4367b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17871:x1876607738494592:12345-0@lo:502:mount.lustre.0 Request processed in 290us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673035.356078:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789673035.361937:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f716300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738494592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789673035.363745:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789673035.363783:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1789673035.363811:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1789673035.363828:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1789673035.363842:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1789673035.363855:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1789673035.363867:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1789673035.363878:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1789673035.363889:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789673035.363900:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1789673035.363912:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1789673035.363957:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738494720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673035.364044:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673035.364393:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738494720 00000100:00100000:0.0:1789673035.364401:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738494720 00000100:00100000:0.0:1789673035.364469:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789673035.364480:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4367b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17871:x1876607738494720:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789673035.364617:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4367b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17871:x1876607738494720:12345-0@lo:502:mount.lustre.0 Request processed in 139us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673035.364627:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789673035.364887:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789673035.364909:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738494720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789673035.364964:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1789673035.364974:0:17871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789673035.365921:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789673035.365933:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673035.365935:0:17885:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789673035.365943:0:17885:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfb46b12800 00000020:00000080:0.0:1789673035.365946:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789673035.365953:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789673035.365956:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673035.365957:0:17885:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789673035.365960:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789673035.365962:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673035.365963:0:17885:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789673035.365967:0:17885:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfb46b12800 00000020:00000080:0.0:1789673035.365968:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789673035.366070:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789673035.366074:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673035.366076:0:17885:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789673035.366079:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789673035.366081:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673035.366082:0:17885:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789673035.366086:0:17885:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfb46b12800 00000020:00000080:0.0:1789673035.366089:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789673035.372306:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789673035.373356:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789673035.373361:0:17885:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789673035.373371:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789673035.373377:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789673035.373379:0:17885:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789673035.373385:0:17885:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfb46b12800 00000020:00000080:3.0:1789673035.373396:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789673035.374911:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789673035.374921:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789673035.374923:0:17885:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789673035.374928:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1789673035.377610:0:17871:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789673035.377700:0:17871:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789673035.377729:0:17871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee200/0x6c78c4f8c99662d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99662e0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673035.377743:0:17871:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee200/0x6c78c4f8c99662d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99662e0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789673035.377831:0:17871:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789673035.377834:0:17871:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfb46b12800 10000000:01000000:1.0:1789673035.377837:0:17871:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfb46b12800 10000000:01000000:1.0:1789673035.377842:0:17871:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789673035.377847:0:17871:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfb46b12800 from 1 10000000:01000000:1.0:1789673035.377849:0:17871:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789673035.377900:0:17871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52434400/0x6c78c4f8c99662e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673035.377907:0:17871:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc52434400/0x6c78c4f8c99662e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673035.377919:0:17871:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc52434400/0x6c78c4f8c99662e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673035.377945:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738494848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789673035.378022:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673035.381976:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc733843c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789673035.384739:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738494848 00000100:00100000:2.0:1789673035.384757:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738494848 00000100:00100000:2.0:1789673035.389257:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789673035.389280:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc43679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17871:x1876607738494848:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789673035.389310:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673035.389334:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb46aefc00/0x6c78c4f8c99662ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99662e7 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.389368:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb46aefc00/0x6c78c4f8c99662ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99662e7 expref: 18 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.389379:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb46aefc00/0x6c78c4f8c99662ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99662e7 expref: 18 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673035.389388:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aefc00, rc 0) 00000100:00100000:2.0:1789673035.389558:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc43679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17871:x1876607738494848:12345-0@lo:101:mount.lustre.0 Request processed in 289us (11535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673035.389566:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789673035.392382:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738494848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789673035.392414:0:17871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc52434400/0x6c78c4f8c99662e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99662ee expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673035.392428:0:17871:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc52434400/0x6c78c4f8c99662e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99662ee expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789673035.404709:0:17871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789673035.405149:0:17871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789673035.406771:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789673035.408148:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1789673035.408171:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1789673035.408183:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1789673035.408195:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1789673035.408206:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1789673035.408234:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1789673035.408246:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1789673035.408258:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1789673035.408268:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1789673035.408280:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1789673035.408290:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1789673035.408301:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1789673035.408311:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1789673035.408322:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1789673035.408332:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1789673035.408343:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1789673035.408354:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1789673035.408373:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1789673035.408384:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1789673035.408395:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1789673035.408406:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1789673035.408427:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1789673035.408440:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1789673035.408451:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1789673035.408462:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1789673035.408473:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1789673035.415404:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1789673035.415523:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1789673035.415532:0:17871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789673035.415676:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738494976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789673035.415752:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.415808:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc57be9480 going to sleep for 11 seconds 00000100:00100000:1.0:1789673035.425994:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738494976 00000100:00100000:1.0:1789673035.426011:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738494976 00000100:00100000:1.0:1789673035.426104:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789673035.426116:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4367a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17871:x1876607738494976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789673035.426304:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4367a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17871:x1876607738494976:12345-0@lo:501:mount.lustre.0 Request processed in 191us (10552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673035.426313:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789673035.427251:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738494976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789673035.427313:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738495104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789673035.427376:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.427422:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc57be9480 going to sleep for 11 seconds 00000100:00100000:2.0:1789673035.428999:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738495104 00000100:00100000:2.0:1789673035.429011:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738495104 00000100:00100000:2.0:1789673035.429080:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789673035.429091:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc43678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17871:x1876607738495104:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789673035.429254:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc43678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17871:x1876607738495104:12345-0@lo:503:mount.lustre.0 Request processed in 164us (1878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673035.429263:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789673035.429333:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738495104:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789673035.432304:0:17871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789673035.432418:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738495232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673035.433939:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.433993:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc57be9480 going to sleep for 11 seconds 00000100:00100000:3.0:1789673035.434078:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738495232 00000100:00100000:3.0:1789673035.434087:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738495232 00000100:00100000:3.0:1789673035.434140:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789673035.434150:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4367a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17871:x1876607738495232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789673035.434299:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4367a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17871:x1876607738495232:12345-0@lo:502:mount.lustre.0 Request processed in 150us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673035.434308:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789673035.435003:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738495232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789673035.435253:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789673035.435287:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1789673035.435305:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1789673035.435320:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1789673035.435333:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1789673035.435347:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1789673035.435359:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1789673035.435371:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1789673035.435386:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1789673035.435400:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1789673035.435419:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1789673035.435434:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1789673035.435447:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1789673035.435462:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1789673035.435476:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1789673035.436985:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1789673035.437029:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1789673035.437044:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1789673035.437058:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1789673035.437090:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1789673035.437578:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1789673035.437595:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1789673035.437607:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1789673035.437619:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1789673035.437633:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1789673035.437647:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1789673035.437759:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1789673035.437776:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1789673035.437790:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1789673035.438846:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1789673035.438864:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1789673035.438879:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1789673035.438914:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1789673035.438929:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1789673035.438940:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1789673035.438965:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1789673035.438979:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1789673035.438993:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1789673035.439006:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1789673035.439019:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1789673035.439032:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1789673035.439047:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1789673035.439059:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1789673035.439071:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1789673035.439084:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1789673035.439097:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1789673035.439111:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1789673035.439140:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1789673035.439226:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738495360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673035.439313:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.439373:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc57be9480 going to sleep for 11 seconds 00000100:00100000:3.0:1789673035.440579:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738495360 00000100:00100000:3.0:1789673035.440591:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738495360 00000100:00100000:3.0:1789673035.440682:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789673035.440695:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc43678c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17871:x1876607738495360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789673035.441056:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc43678c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17871:x1876607738495360:12345-0@lo:502:mount.lustre.0 Request processed in 364us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673035.441065:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789673035.450154:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738495360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789673035.450425:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1789673035.456192:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1789673035.456264:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738495488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673035.456359:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.456419:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc57be9480 going to sleep for 11 seconds 00000100:00100000:0.0:1789673035.457773:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738495488 00000100:00100000:0.0:1789673035.457785:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738495488 00000100:00100000:0.0:1789673035.457867:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789673035.457877:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc43679050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17871:x1876607738495488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789673035.458072:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc43679050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17871:x1876607738495488:12345-0@lo:502:mount.lustre.0 Request processed in 195us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673035.458080:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789673035.458247:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738495488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789673035.458345:0:17871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1789673035.458359:0:17871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789673035.460325:0:17891:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789673035.460344:0:17891:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8cfb477b3380) 00000020:00000080:2.0:1789673035.460371:0:17891:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789673035.460509:0:17891:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfb46b12800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789673035.460513:0:17891:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfb46b12800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789673035.460516:0:17891:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfb46b12800 3 00010000:00080000:2.0:1789673035.460549:0:17891:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfb47964000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.150@tcp at head 00010000:00010000:0.0:1789673035.463312:0:17891:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789673035.467224:0:17891:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789673035.467291:0:17891:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789673035.467309:0:17891:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x6c78c4f8c99662fc 00000100:00080000:0.0:1789673035.467325:0:17891:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789673035.467339:0:17891:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8cfb47964000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789673035.467385:0:17891:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc462dd880 x1876607738495616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789673035.467429:0:17891:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789673035.467860:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876607738495616:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789673035.467935:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673035.468024:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738495616 00000100:00100000:3.0:1789673035.468032:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738495616 00000100:00100000:3.0:1789673035.468068:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789673035.468076:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1876607738495616:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789673035.468102:0:17139:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:3.0:1789673035.468139:0:17139:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x6c78c4f8c9966303 00000004:00100000:3.0:1789673035.468153:0:17139:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789673035.468184:0:17139:0:(import.c:65:import_set_state_nolock()) ffff8cfc67edc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789673035.468231:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1876607738495616:12345-0@lo:38:llog_process_th.0 Request processed in 154us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673035.468238:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789673035.468290:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfc462dd880 x1876607738495616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789673045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673035.468301:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789673035.468308:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789673035.468315:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789673035.468320:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789673035.468322:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb47964000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789673035.468328:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1876607738495616:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789673035.468469:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789673035.468475:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789673035.468478:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789673035.468888:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789673035.470327:0:17891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1789673035.474164:0:17871:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789673035.474219:0:17871:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789673035.474249:0:17871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52434400/0x6c78c4f8c99662e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99662ee expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.474262:0:17871:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc52434400/0x6c78c4f8c99662e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99662ee expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789673035.474332:0:17871:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789673035.474334:0:17871:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789673035.474336:0:17871:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789673035.474337:0:17871:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789673035.474338:0:17871:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789673035.474340:0:17871:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789673035.474341:0:17871:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789673035.474343:0:17871:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789673035.474344:0:17871:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789673035.474348:0:17871:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1789673035.474351:0:17871:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789673035.474352:0:17871:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789673035.474354:0:17871:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789673035.474355:0:17871:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789673035.474356:0:17871:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789673035.474357:0:17871:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789673035.474358:0:17871:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789673035.474359:0:17871:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789673035.474360:0:17871:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789673035.474390:0:17871:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789673035.474410:0:17871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738495744:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789673035.475276:0:17871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673035.475317:0:17871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc434b4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789673035.482944:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738495744 00000100:00100000:2.0:1789673035.482962:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738495744 00000100:00100000:2.0:1789673035.483577:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789673035.483592:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc43678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17871:x1876607738495744:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789673035.483632:0:17132:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789673035.483647:0:17132:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1789673035.490073:0:17118:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789673035.490297:0:17132:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789673035.490317:0:17132:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789673035.496448:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc43678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17871:x1876607738495744:12345-0@lo:253:mount.lustre.0 Request processed in 12837us (21151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673035.496467:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789673035.496568:0:17871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17871:1876607738495744:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789673035.496584:0:17871:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789673035.496588:0:17871:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789673035.496590:0:17871:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789673035.496591:0:17871:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789673035.496609:0:17871:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789673035.496610:0:17871:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789673035.496611:0:17871:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789673035.496613:0:17871:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789673035.496615:0:17871:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789673035.496616:0:17871:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789673035.496632:0:17871:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789673035.501385:0:17154:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789673035.501396:0:17154:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789673035.501422:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfc7d8cde00/0x6c78c4f8c996630a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.501443:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c996620e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9966207 expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.501451:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfb46aee800/0x6c78c4f8c99662d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99662cb expref: 17 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.501471:0:17154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfc7d8cde00/0x6c78c4f8c996630a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.501531:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfb46aee800/0x6c78c4f8c99662d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c99662cb expref: 17 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.501546:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfb46aee800/0x6c78c4f8c99662d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c99662cb expref: 17 pid: 17131 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673035.501562:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876607738495872:0@lo:104: 00000100:00100000:0.0:1789673035.501630:0:17154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789673035.501718:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c996620e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9966207 expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.501727:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c996620e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9966207 expref: 17 pid: 17133 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673035.501736:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876607738496000:0@lo:104: 00000100:00100000:0.0:1789673035.501757:0:17154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673035.501775:0:17154:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc434b46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789673035.501815:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738495872 00000100:00100000:0.0:1789673035.501822:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738495872 00000100:00100000:0.0:1789673035.501858:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738496000 00000100:00100000:0.0:1789673035.501860:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738496000 00000100:00100000:0.0:1789673035.501875:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789673035.501882:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+4:17154:x1876607738495872:12345-0@lo:104: 00010000:00010000:0.0:1789673035.501896:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99662cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99662d2 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.501974:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789673035.501980:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+4:17154:x1876607738495872:12345-0@lo:104: Request processed in 99us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673035.501987:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789673035.502004:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789673035.502011:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+3:17154:x1876607738496000:12345-0@lo:104: 00010000:00010000:0.0:1789673035.502019:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c996620e expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502051:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789673035.502056:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+3:17154:x1876607738496000:12345-0@lo:104: Request processed in 47us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673035.502062:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789673035.502082:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789673035.502088:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99662cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99662d2 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502107:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aef400 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789673035.502112:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99662cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c99662d2 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502121:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99662cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c99662d2 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789673035.502129:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99662cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c99662d2 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789673035.502134:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789673035.502171:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99662cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99662d2 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502178:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789673035.502201:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99662cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99662d2 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502208:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99662cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99662d2 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502221:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789673035.502224:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c996620e expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502230:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd000 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789673035.502233:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c996620e expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502241:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c996620e expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789673035.502247:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c996620e expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789673035.502253:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789673035.502264:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966207 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996620e expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502269:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789673035.502275:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966207 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996620e expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502292:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966207 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996620e expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502304:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673035.502306:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673035.502307:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673035.502314:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673035.502326:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738496128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789673035.502355:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673035.502375:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789673035.502380:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738496256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789673035.502398:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673035.502428:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738496128 00000100:00100000:0.0:1789673035.502433:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738496128 00010000:00010000:0.0:1789673035.502448:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfb46aee800/0x6c78c4f8c99662d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99662cb expref: 18 pid: 17131 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673035.502468:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738496256 00000100:00100000:0.0:1789673035.502471:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738496256 00010000:00010000:0.0:1789673035.502481:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c996620e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9966207 expref: 19 pid: 17133 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673035.502493:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789673035.502499:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+19:3637:x1876607738496128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789673035.502509:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789673035.502512:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfb46aee800/0x6c78c4f8c99662d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99662cb expref: 19 pid: 17131 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502532:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfb46aee800/0x6c78c4f8c99662d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c99662cb expref: 19 pid: 17131 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502546:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789673035.502571:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+19:3637:x1876607738496128:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673035.502578:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789673035.502589:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789673035.502594:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:3637:x1876607738496256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789673035.502601:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789673035.502604:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c996620e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9966207 expref: 18 pid: 17133 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502612:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c996620e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9966207 expref: 18 pid: 17133 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502622:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfc7d8cde00/0x6c78c4f8c996630a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502629:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8cde00/0x6c78c4f8c996630a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789673035.502641:0:17123:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001694491s 00010000:00010000:0.0:1789673035.502645:0:17123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc7d8cde00/0x6c78c4f8c996630a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502692:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc7d8cde00/0x6c78c4f8c996630a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502709:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfc7d8cde00/0x6c78c4f8c996630a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502716:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfc7d8cde00/0x6c78c4f8c996630a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502722:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cde00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789673035.502726:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfc7d8cde00/0x6c78c4f8c996630a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502734:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfc7d8cde00/0x6c78c4f8c996630a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502743:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfc7d8cde00/0x6c78c4f8c996630a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502752:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789673035.502774:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:3637:x1876607738496256:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673035.502780:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789673035.502847:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738496256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789673035.502855:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738496128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789673035.502882:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfb46aee800/0x6c78c4f8c99662d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c99662cb expref: 17 pid: 17131 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673035.502893:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876607738495872:0@lo:104: 00010000:00010000:0.0:1789673035.502903:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c996620e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9966207 expref: 16 pid: 17133 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673035.502919:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876607738496000:0@lo:104: 00010000:00010000:0.0:1789673035.502931:0:17154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfc7d8cde00/0x6c78c4f8c996630a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502939:0:17154:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfc7d8cde00/0x6c78c4f8c996630a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502946:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8cde00/0x6c78c4f8c996630a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673035.502952:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8cde00/0x6c78c4f8c996630a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1789673035.527355:0:17871:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789673035.527462:0:17896:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789673035.527468:0:17896:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789673035.528454:0:17897:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1789673035.529467:0:17897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789673035.533001:0:17871:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1789673035.535075:0:17897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789673035.535567:0:17897:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1789673035.536387:0:17871:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1789673035.536434:0:17871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789673035.537002:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17898:1876607738496384:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789673035.537082:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.537136:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc57be90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789673035.537198:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738496384 00000100:00100000:3.0:1789673035.537206:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738496384 00000100:00100000:3.0:1789673035.537259:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789673035.537270:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17898:x1876607738496384:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789673035.537361:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17898:x1876607738496384:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 93us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673035.537369:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789673035.537457:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17898:1876607738496384:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1789673035.537508:0:17898:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789673035.537535:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17898:1876607738496512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789673035.537564:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.537591:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc57be90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789673035.537722:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738496512 00000100:00100000:3.0:1789673035.537727:0:17882:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738496512 00000100:00100000:3.0:1789673035.537758:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789673035.537766:0:17882:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17898:x1876607738496512:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789673035.537949:0:17882:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17898:x1876607738496512:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 183us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673035.537955:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789673035.538133:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17898:1876607738496512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789673035.538195:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17898:1876607738496640:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789673035.538228:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.538256:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc57be9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789673035.538319:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738496640 00000100:00100000:3.0:1789673035.538325:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738496640 00000100:00100000:3.0:1789673035.538361:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789673035.538369:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17898:x1876607738496640:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789673035.538410:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17898:x1876607738496640:12345-0@lo:900:lod0001_rec0000.0 Request processed in 42us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673035.538417:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789673035.538586:0:17898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cfc7f715c00 x1876607738496640/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789673051 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673035.538598:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17898:1876607738496640:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789673035.538636:0:17898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17898:1876607738496768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789673035.538702:0:17898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673035.538719:0:17898:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc57be90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789673035.538778:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738496768 00000100:00100000:3.0:1789673035.538783:0:17882:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738496768 00000100:00100000:3.0:1789673035.538941:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789673035.538948:0:17882:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17898:x1876607738496768:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789673035.539038:0:17882:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17898:x1876607738496768:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 91us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673035.539055:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789673035.539109:0:17898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17898:1876607738496768:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789673035.539168:0:17898:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789673035.541252:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789673035.541356:0:17898:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789673035.541362:0:17898:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000004:00000080:0.0:1789673035.541971:0:17871:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789673035.542012:0:17871:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1789673035.542124:0:17871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789673035.543120:0:17871:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789673035.543728:0:17871:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789673035.543767:0:17871:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1789673035.543959:0:17871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789673035.544617:0:17871:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:0.0:1789673035.551371:0:17871:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789673035.578959:0:17871:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789673035.579010:0:17871:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffac6d81c4f988 00100000:10000000:2.0:1789673035.579019:0:17871:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789673035.585820:0:17871:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789673035.585869:0:17871:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789673035.585888:0:17871:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789673035.585923:0:17871:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1789673035.592397:0:17871:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789673035.592687:0:17871:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789673035.846605:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789673036.356265:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00000040:00080000:1.0:1789673036.553995:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789673036.894108:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789673037.194895:0:17135:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789673037.194904:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfb46b12800 from 8 10000000:01000000:0.0:1789673037.194909:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789673037.194966:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966311 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673037.194980:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966311 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673037.194991:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966311 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673037.195017:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738496896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789673037.195088:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673037.195155:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc430b4480 going to sleep for 11 seconds 00000100:00100000:3.0:1789673037.196380:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738496896 00000100:00100000:3.0:1789673037.196392:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738496896 00000100:00100000:3.0:1789673037.196455:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789673037.196466:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4367bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+16:17135:x1876607738496896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789673037.196483:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673037.196504:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb482e5c00/0x6c78c4f8c9966318 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9966311 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673037.196531:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb482e5c00/0x6c78c4f8c9966318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9966311 expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673037.196543:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb482e5c00/0x6c78c4f8c9966318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9966311 expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673037.196552:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e5c00, rc 0) 00000100:00100000:3.0:1789673037.196614:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4367bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17135:x1876607738496896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673037.196632:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789673037.196775:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738496896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789673037.196794:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966311 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966318 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673037.196804:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966311 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9966318 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673037.196889:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738497024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789673037.196927:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673037.196964:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4bb89600 going to sleep for 11 seconds 00000100:00100000:3.0:1789673037.197109:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738497024 00000100:00100000:3.0:1789673037.197115:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738497024 00000100:00100000:3.0:1789673037.197148:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789673037.197155:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4367ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17135:x1876607738497024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789673037.197168:0:17132:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789673037.197185:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789673037.197188:0:17132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789673037.197264:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4367ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17135:x1876607738497024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673037.197271:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789673037.197499:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738497024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789673037.197545:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789673037.197553:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966311 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966318 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673037.197562:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966318 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789673037.197573:0:17135:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789673037.197581:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfc7f765000 from 8 10000000:01000000:1.0:1789673037.197584:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789673037.197603:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c996631f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673037.197610:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c996631f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673037.197618:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c996631f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673037.197642:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738497152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789673037.197711:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673037.197735:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4bb89600 going to sleep for 11 seconds 00000100:00100000:1.0:1789673037.197747:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738497152 00000100:00100000:1.0:1789673037.197751:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738497152 00000100:00100000:1.0:1789673037.197776:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789673037.197782:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17135:x1876607738497152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789673037.197790:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789673037.197799:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52435c00/0x6c78c4f8c9966326 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c996631f expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673037.197815:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52435c00/0x6c78c4f8c9966326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c996631f expref: 18 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673037.197824:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52435c00/0x6c78c4f8c9966326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c996631f expref: 18 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673037.197831:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52435c00, rc 0) 00000100:00100000:1.0:1789673037.197870:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17135:x1876607738497152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673037.197883:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789673037.197912:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738497152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789673037.197922:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c996631f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966326 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673037.197929:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c996631f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9966326 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673037.197963:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738497280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789673037.197989:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673037.198001:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4bb89600 going to sleep for 11 seconds 00000100:00100000:1.0:1789673037.198012:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738497280 00000100:00100000:1.0:1789673037.198016:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738497280 00000100:00100000:1.0:1789673037.198036:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789673037.198041:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17135:x1876607738497280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789673037.198051:0:17132:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789673037.198061:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789673037.198064:0:17132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789673037.198153:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17135:x1876607738497280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673037.198160:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789673037.198187:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738497280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789673037.198217:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789673037.198223:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c996631f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966326 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673037.198240:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c996631f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966326 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673037.381739:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00000040:00080000:1.0:1789673037.572410:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789673037.892007:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789673038.404484:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00010000:00010000:0.0:1789673038.916742:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789673039.368871:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789673039.433692:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00010000:00010000:0.0:1789673039.942318:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673040.452059:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 0 seconds 00000100:00080000:1.0:1789673040.708786:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789673040.708794:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789673040.708798:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c3000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789673040.708818:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cfc458c3000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789673040.708841:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d8df480 x1876607738497536/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789673040.708860:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673040.708864:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789673040.708866:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673040.708869:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789673040.708896:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673040.708911:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789673040.708913:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673040.708916:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789673040.708951:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738497536:0@lo:38:kworker.0 00000100:00100000:1.0:1789673040.709018:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673040.709101:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738497792:0@lo:400:kworker.0 00000100:00100000:1.0:1789673040.709137:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673040.709167:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789673040.709172:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738497920:0@lo:400:kworker.0 00000100:00100000:1.0:1789673040.709204:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673040.709238:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738497536 00000100:00100000:1.0:1789673040.709246:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738497536 00000100:00100000:1.0:1789673040.709276:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738497792 00000100:00100000:1.0:1789673040.709279:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738497792 00000100:00100000:1.0:1789673040.709305:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789673040.709312:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1876607738497536:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789673040.709340:0:17143:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:1.0:1789673040.709377:0:17143:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c78c4f8c996632d 00000004:00100000:1.0:1789673040.709391:0:17143:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789673040.709397:0:17143:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1789673040.709475:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789673040.709483:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738497792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673040.709531:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738497792:12345-0@lo:400:kworker.0 Request processed in 49us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673040.709539:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789673040.709575:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738497920 00000100:00100000:1.0:1789673040.709579:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738497920 00000100:00100000:1.0:1789673040.709609:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789673040.709615:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738497920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673040.709644:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738497920:12345-0@lo:400:kworker.0 Request processed in 30us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673040.709651:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789673040.709713:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc7d8dea00 x1876607738497920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673040.709738:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738497920:0@lo:400:kworker.0 00000100:00100000:1.0:1789673040.709750:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738497792:0@lo:400:kworker.0 00000100:00100000:3.0:1789673040.710887:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738497664:0@lo:400:kworker.0 00000100:00100000:3.0:1789673040.710940:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673040.710979:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789673040.710987:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3636:1876607738497408:0@lo:400:kworker.0 00000100:00100000:3.0:1789673040.711019:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673040.711931:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789673040.711941:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738498048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789673040.711979:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673040.712386:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738497664 00000100:00100000:1.0:1789673040.712395:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738497664 00000100:00100000:1.0:1789673040.712442:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789673040.712450:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738497664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673040.712504:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738497664:12345-0@lo:400:kworker.0 Request processed in 55us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673040.712511:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789673040.712536:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738497408 00000100:00100000:1.0:1789673040.712540:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738497408 00000100:00100000:1.0:1789673040.712582:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789673040.712589:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:3636:x1876607738497408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673040.712619:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:3636:x1876607738497408:12345-0@lo:400:kworker.0 Request processed in 31us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673040.712625:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789673040.712672:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738498048 00000100:00100000:1.0:1789673040.712676:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738498048 00000100:00100000:1.0:1789673040.712701:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789673040.712707:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738498048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789673040.712733:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789673040.712767:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738498048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673040.712774:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789673040.712816:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738498048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789673040.712839:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3636:1876607738497408:0@lo:400:kworker.0 00010000:00080000:1.0:1789673040.712851:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc7d8dca80 x1876607738497664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673040.712862:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738497664:0@lo:400:kworker.0 00000100:00080000:1.0:1789673040.727568:0:17143:0:(import.c:65:import_set_state_nolock()) ffff8cfc67edf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789673040.727711:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1876607738497536:12345-0@lo:38:kworker.0 Request processed in 18396us (18691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673040.727723:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789673040.727818:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789673040.727828:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789673040.727834:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789673040.727837:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c3000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789673040.727862:0:3634:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000001f1b0dd0): req@ffff8cfc462dca80 x1876607738490240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673040.727886:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738497536:0@lo:38:kworker.0 00000100:00100000:1.0:1789673040.727990:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789673040.728004:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738498176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789673040.728053:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673040.728097:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738498176 00000100:00100000:1.0:1789673040.728104:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738498176 00000100:00100000:1.0:1789673040.728138:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789673040.728146:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1876607738498176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789673040.728171:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789673040.728206:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1876607738498176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673040.728213:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789673040.728248:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738498176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789673040.728706:0:17180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673040.728729:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 11 seconds 00000100:00100000:1.0:1789673040.728800:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738490240 00000100:00100000:1.0:1789673040.728805:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738490240 00000100:00100000:1.0:1789673040.728829:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789673040.728836:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17180:x1876607738490240:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789673040.728908:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17180:x1876607738490240:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673040.728930:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789673040.728957:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17180:1876607738490240:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1789673040.728993:0:17180:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789673040.729026:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17180:1876607738498304:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789673040.729225:0:17180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673040.729256:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551600 going to sleep for 11 seconds 00000100:00100000:3.0:1789673040.729296:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738498304 00000100:00100000:3.0:1789673040.729300:0:17882:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738498304 00000100:00100000:3.0:1789673040.729334:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789673040.729341:0:17882:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17180:x1876607738498304:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789673040.729441:0:17882:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17180:x1876607738498304:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 101us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673040.729448:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789673040.729512:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17180:1876607738498304:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789673040.729609:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17180:1876607738498432:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789673040.729634:0:17180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673040.729683:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551180 going to sleep for 11 seconds 00000100:00100000:1.0:1789673040.729706:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738498432 00000100:00100000:1.0:1789673040.729711:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738498432 00000100:00100000:1.0:1789673040.729736:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789673040.729743:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17180:x1876607738498432:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789673040.729793:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17180:x1876607738498432:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 50us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673040.729800:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789673040.729828:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17180:1876607738498432:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789673040.729869:0:17180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789673040.732950:0:17180:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789673040.733124:0:17180:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 23, retries 0 00000004:00080000:1.0:1789673040.733130:0:17180:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789673040.964399:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789673041.202879:0:18141:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789673041.995033:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789673042.200542:0:18193:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789673042.201079:0:18193:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789673042.758364:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789673027/real 1789673027] req@ffff8cfc7d8de680 x1876607738491264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673042 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789673042.758396:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfc7d8de680 x1876607738491264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673042 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789673042.758408:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789673027/real 1789673027] req@ffff8cfc7d8dd180 x1876607738491392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673042 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789673042.758433:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfc7d8dd180 x1876607738491392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673042 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789673042.758456:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb4693c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789673042.758478:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789673042.758482:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738491264:0@lo:8:kworker.0 00000100:00080000:0.0:1789673042.758488:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789673042.758493:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789673042.758495:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738491392:0@lo:8:kworker.0 00000100:00080000:1.0:1789673042.758628:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673042.758633:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789673042.758643:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfb4693c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789673042.758648:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 505 00000100:00080000:1.0:1789673042.758655:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789673042.758694:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cfb4693c000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789673042.758716:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d8dd500 x1876607738498816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789673042.758731:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673042.758734:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789673042.758736:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789673042.758738:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 505 00000100:00080000:1.0:1789673042.758741:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789673042.758745:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfc458c7800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789673042.758756:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d8ded80 x1876607738498944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789673042.758788:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673042.758792:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789673042.758795:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673042.758798:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789673042.758826:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738498688:0@lo:400:kworker.0 00000100:00100000:1.0:1789673042.758891:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673042.758938:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789673042.758944:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3638:1876607738498560:0@lo:400:kworker.0 00000100:00100000:1.0:1789673042.758974:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673042.759004:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738499328:0@lo:400:kworker.0 00000100:00100000:1.0:1789673042.759038:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673042.759066:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738499072:0@lo:400:kworker.0 00000100:00100000:1.0:1789673042.759087:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673042.759104:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789673042.759109:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738499200:0@lo:400:kworker.0 00000100:00100000:1.0:1789673042.759132:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673042.759163:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738498688 00000100:00100000:1.0:1789673042.759171:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738498688 00000100:00100000:1.0:1789673042.759215:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738499200 00000100:00100000:1.0:1789673042.759219:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738499200 00000100:00100000:1.0:1789673042.759235:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789673042.759244:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876607738498688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673042.759294:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876607738498688:12345-0@lo:400:kworker.0 Request processed in 51us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673042.759301:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789673042.759317:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789673042.759324:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738499200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673042.759355:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738499200:12345-0@lo:400:kworker.0 Request processed in 32us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673042.759361:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789673042.759378:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738499328 00000100:00100000:1.0:1789673042.759382:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738499328 00000100:00100000:1.0:1789673042.759405:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738499072 00000100:00100000:1.0:1789673042.759407:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738499072 00000100:00100000:1.0:1789673042.759419:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789673042.759425:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738499328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673042.759454:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738499328:12345-0@lo:400:kworker.0 Request processed in 29us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673042.759467:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789673042.759479:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789673042.759485:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738499072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673042.759514:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738499072:12345-0@lo:400:kworker.0 Request processed in 29us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673042.759519:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789673042.759579:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738499200:0@lo:400:kworker.0 00010000:00080000:1.0:1789673042.759592:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc7d8dd180 x1876607738499072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673042.759601:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738499072:0@lo:400:kworker.0 00000100:00100000:1.0:1789673042.759629:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738498816:0@lo:8:kworker.0 00000400:00000100:1.0:1789673042.759655:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876607738498816 offset 0 length 520: 4 00000100:00100000:1.0:1789673042.759694:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738498944:0@lo:8:kworker.0 00000400:00000100:1.0:1789673042.759716:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876607738498944 offset 0 length 520: 4 00010000:00080000:1.0:1789673042.759744:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc7d8df480 x1876607738499328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673042.759754:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738499328:0@lo:400:kworker.0 00000100:00100000:1.0:1789673042.759764:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738498688:0@lo:400:kworker.0 00000100:00100000:2.0:1789673042.760598:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738498560 00000100:00100000:2.0:1789673042.760607:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738498560 00000100:00100000:2.0:1789673042.760922:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789673042.760933:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:3638:x1876607738498560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789673042.761011:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:3638:x1876607738498560:12345-0@lo:400:kworker.0 Request processed in 81us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673042.761018:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789673042.761115:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3638:1876607738498560:0@lo:400:kworker.0 00010000:00010000:0.0:1789673043.016110:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789673043.169036:0:18243:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789673043.169645:0:18243:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789673044.035820:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789673044.039990:0:18292:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc9eee790 20000000:00000080:1.0:1789673044.040020:0:18292:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cfc659df400 uarg=0000000000000000 20000000:01000000:1.0:1789673044.040072:0:18292:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789673044.040080:0:18292:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789673044.040090:0:18292:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789673044.040646:0:18293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1789673044.040838:0:18292:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789673044.049053:0:18292:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789673044.049173:0:18292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfb482e5800/0x6c78c4f8c9966334 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673044.049194:0:18292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c99661dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99661d6 expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673044.049202:0:18292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c99662e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99662d9 expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673044.049209:0:18292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfb482e5800/0x6c78c4f8c9966334 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673044.049255:0:18292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c99662e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c99662d9 expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673044.049271:0:18292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c99662e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c99662d9 expref: 17 pid: 17133 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673044.049286:0:18292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18292:1876607738499456:0@lo:104: 00000100:00100000:3.0:1789673044.049353:0:18292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789673044.049425:0:18292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c99661dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c99661d6 expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673044.049434:0:18292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c99661dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c99661d6 expref: 17 pid: 17133 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673044.049443:0:18292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f64a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18292:1876607738499584:0@lo:104: 00000100:00100000:3.0:1789673044.049477:0:18292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673044.049548:0:18292:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7442d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789673044.053313:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738499456 00000100:00100000:1.0:1789673044.053327:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738499456 00000100:00100000:1.0:1789673044.053367:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738499584 00000100:00100000:1.0:1789673044.053369:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738499584 00000100:00100000:1.0:1789673044.053383:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789673044.053391:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+4:18292:x1876607738499456:12345-0@lo:104: 00010000:00010000:1.0:1789673044.053409:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee200/0x6c78c4f8c99662d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99662e0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673044.054424:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789673044.054442:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+4:18292:x1876607738499456:12345-0@lo:104: Request processed in 1042us (5079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673044.054455:0:18292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18292:1876607738499456:0@lo:104: 00000100:00100000:1.0:1789673044.054456:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789673044.054479:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789673044.054488:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+3:18292:x1876607738499584:12345-0@lo:104: 00010000:00010000:1.0:1789673044.054508:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5200/0x6c78c4f8c99661d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99661dd expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673044.054601:0:18292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f64a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18292:1876607738499584:0@lo:104: 00010000:00010000:3.0:1789673044.054654:0:18292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfb482e5800/0x6c78c4f8c9966334 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673044.057470:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789673044.057488:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee200/0x6c78c4f8c99662d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99662e0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673044.057511:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aee200 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789673044.057516:0:17126:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee200/0x6c78c4f8c99662d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c99662e0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673044.057528:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee200/0x6c78c4f8c99662d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c99662e0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789673044.057536:0:17126:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee200/0x6c78c4f8c99662d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c99662e0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789673044.057569:0:17126:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789673044.057639:0:17126:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee200/0x6c78c4f8c99662d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99662e0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673044.057647:0:17126:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789673044.057697:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee200/0x6c78c4f8c99662d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99662e0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673044.057705:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee200/0x6c78c4f8c99662d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99662e0 expref: -99 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673044.057724:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789673044.057728:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5200/0x6c78c4f8c99661d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99661dd expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673044.057735:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5200 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789673044.057738:0:17126:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5200/0x6c78c4f8c99661d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c99661dd expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673044.057745:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5200/0x6c78c4f8c99661d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c99661dd expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789673044.057751:0:17126:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5200/0x6c78c4f8c99661d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c99661dd expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673044.057754:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3638:1876607738499712:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1789673044.057756:0:17126:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789673044.057780:0:17126:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5200/0x6c78c4f8c99661d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99661dd expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673044.057785:0:17126:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789673044.057808:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5200/0x6c78c4f8c99661d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99661dd expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673044.057814:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5200/0x6c78c4f8c99661d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99661dd expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673044.057830:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789673044.057832:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789673044.057832:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673044.057834:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673044.060711:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673044.060711:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789673044.060729:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+3:18292:x1876607738499584:12345-0@lo:104: Request processed in 6238us (11246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673044.060743:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789673044.063799:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789673044.063832:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3636:1876607738499840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789673044.063926:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673044.071959:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738499712 00000100:00100000:2.0:1789673044.071977:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738499712 00010000:00010000:2.0:1789673044.072027:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c99662e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99662d9 expref: 18 pid: 17133 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673044.072074:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738499840 00000100:00100000:2.0:1789673044.072092:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738499840 00010000:00010000:2.0:1789673044.072108:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c99661dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99661d6 expref: 19 pid: 17133 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673044.072122:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789673044.072130:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+19:3638:x1876607738499712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789673044.072146:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789673044.072150:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c99662e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99662d9 expref: 19 pid: 17133 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072161:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c99662e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c99662d9 expref: 19 pid: 17133 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072179:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc52434800/0x6c78c4f8c99662e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c99662d9 expref: 19 pid: 17133 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072194:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789673044.072334:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:3638:x1876607738499712:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (14501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673044.072342:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789673044.072359:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789673044.072365:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:3636:x1876607738499840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789673044.072374:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789673044.072378:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c99661dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99661d6 expref: 17 pid: 17133 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072387:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c99661dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c99661d6 expref: 17 pid: 17133 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072396:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc52434200/0x6c78c4f8c99661dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c99661d6 expref: 17 pid: 17133 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072414:0:17125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfb482e5800/0x6c78c4f8c9966334 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072423:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb482e5800/0x6c78c4f8c9966334 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072440:0:17125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfb482e5800/0x6c78c4f8c9966334 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072447:0:17125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfb482e5800/0x6c78c4f8c9966334 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072455:0:17125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfb482e5800/0x6c78c4f8c9966334 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072462:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfb482e5800/0x6c78c4f8c9966334 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072468:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5800 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789673044.072472:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfb482e5800/0x6c78c4f8c9966334 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072480:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfb482e5800/0x6c78c4f8c9966334 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072507:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfb482e5800/0x6c78c4f8c9966334 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072519:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789673044.072552:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+16:3636:x1876607738499840:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (8626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673044.072564:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789673044.072613:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3636:1876607738499840:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789673044.072765:0:18292:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfb482e5800/0x6c78c4f8c9966334 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072775:0:18292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfb482e5800/0x6c78c4f8c9966334 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673044.072782:0:18292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfb482e5800/0x6c78c4f8c9966334 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673044.075802:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3638:1876607738499712:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789673045.075282:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789673045.639115:0:17135:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789673045.639139:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfb46b12800 from 13 10000000:01000000:1.0:1789673045.639146:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789673045.639206:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c996633b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673045.639218:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c996633b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673045.639230:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c996633b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673045.639258:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738499968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789673045.639333:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673045.639383:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43171840 going to sleep for 11 seconds 00000100:00100000:3.0:1789673045.640057:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738499968 00000100:00100000:3.0:1789673045.640068:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738499968 00000100:00100000:3.0:1789673045.640143:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789673045.641073:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+16:17135:x1876607738499968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789673045.641093:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673045.641116:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb482e4a00/0x6c78c4f8c9966342 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c996633b expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673045.641387:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb482e4a00/0x6c78c4f8c9966342 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c996633b expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673045.641403:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb482e4a00/0x6c78c4f8c9966342 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c996633b expref: 17 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673045.641413:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e4a00, rc 0) 00000100:00100000:3.0:1789673045.641497:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17135:x1876607738499968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 438us (2164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673045.641506:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789673045.642329:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738499968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789673045.642358:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c996633b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966342 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673045.642370:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c996633b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9966342 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673045.642462:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738500096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789673045.642518:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673045.642552:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43171840 going to sleep for 11 seconds 00000100:00100000:1.0:1789673045.643065:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738500096 00000100:00100000:1.0:1789673045.643073:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738500096 00000100:00100000:1.0:1789673045.643249:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789673045.643260:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17135:x1876607738500096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789673045.643403:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17135:x1876607738500096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673045.643426:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789673045.643506:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738500096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789673045.643547:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738500224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789673045.643609:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673045.649353:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7442d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789673045.650395:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738500224 00000100:00100000:0.0:1789673045.650409:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738500224 00000100:00100000:0.0:1789673045.650482:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789673045.650493:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17135:x1876607738500224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789673045.650719:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17135:x1876607738500224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (7108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673045.650728:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789673045.651107:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738500224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789673045.653023:0:18360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789673045.653303:0:17135:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789673045.653337:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789673045.653351:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c996633b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966342 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673045.653365:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c996633b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966342 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789673045.653377:0:17135:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789673045.653380:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc7f765000 from 13 10000000:01000000:0.0:1789673045.653383:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789673045.653422:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c9966349 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673045.653451:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c9966349 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673045.653463:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c9966349 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673045.653498:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738500352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789673045.653568:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673045.653608:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bba540 going to sleep for 11 seconds 00000100:00100000:0.0:1789673045.653627:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738500352 00000100:00100000:0.0:1789673045.653633:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738500352 00000100:00100000:0.0:1789673045.653695:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789673045.653704:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+17:17135:x1876607738500352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789673045.653719:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673045.653733:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8cc800/0x6c78c4f8c9966350 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9966349 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673045.653774:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8cc800/0x6c78c4f8c9966350 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9966349 expref: 18 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673045.653786:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8cc800/0x6c78c4f8c9966350 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9966349 expref: 18 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673045.653795:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cc800, rc 0) 00000100:00100000:0.0:1789673045.653829:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17135:x1876607738500352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673045.653836:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789673045.653886:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738500352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789673045.653900:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c9966349 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966350 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673045.653910:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c9966349 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9966350 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673045.653974:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738500480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789673045.653998:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673045.654009:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bba540 going to sleep for 11 seconds 00000100:00100000:0.0:1789673045.654019:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738500480 00000100:00100000:0.0:1789673045.654023:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738500480 00000100:00100000:0.0:1789673045.654038:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789673045.654044:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17135:x1876607738500480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789673045.654145:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17135:x1876607738500480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673045.654407:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789673045.654442:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738500480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789673045.654483:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738500608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789673045.654527:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673045.654542:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bba540 going to sleep for 11 seconds 00000100:00100000:0.0:1789673045.654553:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738500608 00000100:00100000:0.0:1789673045.654557:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738500608 00000100:00100000:0.0:1789673045.654574:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789673045.654579:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17135:x1876607738500608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789673045.654655:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:17135:x1876607738500608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673045.654693:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789673045.654731:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738500608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789673045.663422:0:18361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789673045.663549:0:17135:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789673045.669092:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789673045.669108:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c9966349 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966350 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673045.669123:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c9966349 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966350 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673045.836808:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738500736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789673045.836895:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673045.836968:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738500736 00000100:00100000:3.0:1789673045.836978:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738500736 00000100:00100000:3.0:1789673045.837032:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789673045.837041:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1876607738500736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789673045.837080:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789673045.837131:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1876607738500736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673045.837138:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789673045.837159:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789673045.837168:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738500864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789673045.837196:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673045.837224:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738500864 00000100:00100000:3.0:1789673045.837228:0:17882:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738500864 00000100:00100000:3.0:1789673045.837251:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789673045.837257:0:17882:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738500864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789673045.837278:0:17882:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789673045.837313:0:17882:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738500864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673045.837319:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789673045.837360:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738500864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789673045.837398:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738500736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789673045.844550:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789673035/real 1789673035] req@ffff8cfc7f648700 x1876607738493824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673045 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673045.844583:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfc7f648700 x1876607738493824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673045 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673045.844741:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789673035/real 1789673035] req@ffff8cfc462ddc00 x1876607738493568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673045 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673045.844754:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfc462ddc00 x1876607738493568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673045 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789673045.844789:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc6173d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789673045.844819:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789673045.844823:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738493824:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789673045.844828:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc44208800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789673045.844834:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789673045.844843:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738493568:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789673045.847514:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673045.847526:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789673045.847528:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673045.847532:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789673045.847611:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673045.847615:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789673045.847618:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfc44208800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789673045.847627:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 513 00000100:00080000:1.0:1789673045.847634:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789673045.847647:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cfc44208800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789673045.847655:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738500992:0@lo:400:kworker.0 00000100:00100000:1.0:1789673045.847681:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d8dd180 x1876607738501120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789673045.847708:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1789673045.847738:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673045.847815:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738501120:0@lo:8:kworker.0 00000400:00000100:2.0:1789673045.847844:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876607738501120 offset 0 length 520: 4 00000100:00080000:1.0:1789673045.848265:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789673045.848268:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cfc6173d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789673045.848271:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 513 00000100:00080000:1.0:1789673045.848275:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789673045.848280:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cfc6173d000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789673045.848297:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d8df480 x1876607738501248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789673045.848362:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738500992 00000100:00100000:1.0:1789673045.848369:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738500992 00000100:00100000:1.0:1789673045.848436:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789673045.848444:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738500992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673045.848516:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876607738500992:12345-0@lo:400:kworker.0 Request processed in 73us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673045.848524:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789673045.848769:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738501248:0@lo:8:kworker.0 00000400:00000100:2.0:1789673045.848801:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876607738501248 offset 0 length 520: 4 00000100:00100000:1.0:1789673045.849315:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738501376:0@lo:400:kworker.0 00000100:00100000:1.0:1789673045.849355:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673045.849404:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738501376 00000100:00100000:1.0:1789673045.849409:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738501376 00000100:00100000:1.0:1789673045.849438:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789673045.849445:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738501376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673045.849497:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738501376:12345-0@lo:400:kworker.0 Request processed in 51us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673045.849504:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789673045.849540:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc7d8de680 x1876607738500992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673045.850540:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876607738500992:0@lo:400:kworker.0 00010000:00080000:1.0:1789673045.850593:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc7d8dca80 x1876607738501376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673045.850616:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738501376:0@lo:400:kworker.0 00000001:00100000:0.0:1789673045.858139:0:17872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789673046.088543:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673047.112794:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789673047.817952:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789673048.134041:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673049.156818:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789673049.604877:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789673050.189583:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789673050.947832:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738501504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789673050.947850:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738501632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789673050.947922:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673050.947962:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673050.948009:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738501504 00000100:00100000:3.0:1789673050.948017:0:17882:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738501504 00000100:00100000:3.0:1789673050.948073:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738501632 00000100:00100000:3.0:1789673050.948076:0:17882:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738501632 00000100:00100000:3.0:1789673050.948092:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789673050.948100:0:17882:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738501504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789673050.948135:0:17882:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789673050.948182:0:17882:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738501504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673050.948189:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789673050.948206:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789673050.948213:0:17882:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738501632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789673050.948231:0:17882:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789673050.948263:0:17882:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738501632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673050.948270:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789673050.948315:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1789673050.948319:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738501632:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789673050.948322:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789673050.948327:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789673050.948331:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789673050.948339:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789673050.948348:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738501760:0@lo:400:kworker.0 00000100:00080000:2.0:1789673050.948349:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789673050.948356:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789673050.948360:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789673050.948363:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789673050.948400:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673050.948430:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738501760 00000100:00100000:2.0:1789673050.948436:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738501760 00000100:00100000:3.0:1789673050.948445:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738501888:0@lo:400:kworker.0 00000100:00100000:2.0:1789673050.948471:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789673050.948478:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673050.948483:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:3637:x1876607738501760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673050.948515:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789673050.948524:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738502016:0@lo:400:kworker.0 00000100:00100000:2.0:1789673050.948538:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:3637:x1876607738501760:12345-0@lo:400:kworker.0 Request processed in 56us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673050.948546:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789673050.948555:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673050.948594:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738501888 00000100:00100000:3.0:1789673050.948598:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738501888 00000100:00100000:3.0:1789673050.948637:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738502016 00000100:00100000:3.0:1789673050.948641:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738502016 00000100:00100000:3.0:1789673050.948654:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789673050.948678:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738501888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673050.948714:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738501888:12345-0@lo:400:kworker.0 Request processed in 37us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673050.948720:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789673050.948731:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789673050.948736:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738502016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673050.948756:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738502016:12345-0@lo:400:kworker.0 Request processed in 21us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673050.948762:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789673050.948788:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc7f717800 x1876607738502016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673050.948799:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738502016:0@lo:400:kworker.0 00010000:00080000:3.0:1789673050.948808:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc7f716d80 x1876607738501888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673050.948816:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738501888:0@lo:400:kworker.0 00000100:00100000:3.0:1789673050.948840:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738501504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789673050.948855:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738501760:0@lo:400:kworker.0 00010000:00010000:1.0:1789673051.205180:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789673051.506068:0:18641:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789673051.506073:0:18641:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789673051.506075:0:18641:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789673051.506218:0:18641:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cfc6596c000 00000020:01000004:0.0:1789673051.506237:0:18641:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789673051.506254:0:18641:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789673051.506269:0:18641:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cfc815db380) 00000020:00000080:0.0:1789673051.506289:0:18641:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789673051.546026:0:18641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789673051.547285:0:18641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789673051.547841:0:18641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789673051.548037:0:18641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789673051.548276:0:18641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789673051.548592:0:18641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789673051.548846:0:18641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1789673051.551882:0:18641:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789673051.552107:0:18641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789673051.552121:0:18641:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789673051.552135:0:18641:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6c78c4f8c996635e 00000020:01000004:2.0:1789673051.552141:0:18641:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789673051.552164:0:18641:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.150@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789673051.552167:0:18641:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789673051.552174:0:18641:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789673051.552179:0:18641:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789673051.552190:0:18641:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cfb477b4d40) 00000020:00000080:2.0:1789673051.552201:0:18641:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789673051.553867:0:18641:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789673051.554060:0:18641:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789673051.554067:0:18641:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789673051.563222:0:18641:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789673051.563238:0:18641:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789673051.563974:0:18641:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789673051.563984:0:18641:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789673051.565871:0:18641:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789673051.566086:0:18641:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789673051.566094:0:18641:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789673051.567046:0:18641:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789673051.567060:0:18641:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789673051.598040:0:18641:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789673051.598404:0:18641:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789673051.598412:0:18641:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789673051.600888:0:18641:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789673051.600904:0:18641:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789673051.602946:0:18641:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789673051.602961:0:18641:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789673051.606076:0:18641:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789673051.606290:0:18641:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789673051.606297:0:18641:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789673051.607295:0:18641:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789673051.607303:0:18641:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789673051.665115:0:18641:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789673051.665449:0:18641:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789673051.665456:0:18641:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789673051.667267:0:18641:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789673051.668477:0:18641:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789673051.669274:0:18641:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789673051.669312:0:18641:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789673051.669394:0:18641:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789673051.685046:0:18641:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789673051.685123:0:18641:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.150@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789673051.685128:0:18641:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789673051.685130:0:18641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789673051.685131:0:18641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789673051.685137:0:18641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789673051.685138:0:18641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789673051.685139:0:18641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789673051.685141:0:18641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789673051.685142:0:18641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789673051.685143:0:18641:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789673051.685147:0:18641:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789673051.685149:0:18641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789673051.685150:0:18641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789673051.685151:0:18641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789673051.685152:0:18641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789673051.685153:0:18641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789673051.685154:0:18641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789673051.685155:0:18641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789673051.685156:0:18641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789673051.685156:0:18641:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789673051.685185:0:18641:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789673051.685207:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738502144:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789673051.685286:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673051.685386:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bbae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789673051.685488:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738502144 00000100:00100000:3.0:1789673051.685496:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738502144 00000100:00100000:3.0:1789673051.685601:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789673051.685613:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:18641:x1876607738502144:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789673051.685649:0:17133:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789673051.685653:0:17133:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789673051.685709:0:17133:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789673051.686011:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:18641:x1876607738502144:12345-0@lo:253:mount.lustre.0 Request processed in 399us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673051.686020:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789673051.686110:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738502144:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789673051.686122:0:18641:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789673051.686125:0:18641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789673051.686126:0:18641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789673051.686127:0:18641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789673051.686128:0:18641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789673051.686129:0:18641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789673051.686131:0:18641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789673051.686132:0:18641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789673051.686134:0:18641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789673051.686135:0:18641:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789673051.686155:0:18641:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfc6596c000 from lustre-OST0000 10000000:01000000:0.0:1789673051.686214:0:18641:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789673051.686218:0:18641:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789673051.686227:0:18641:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cfb477b0000 local copy 00010000:00010000:0.0:1789673051.686238:0:18641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cc600/0x6c78c4f8c9966119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966120 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673051.686348:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738502272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789673051.686401:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673051.686590:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc47a21180 going to sleep for 11 seconds 00000100:00100000:2.0:1789673051.686775:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738502272 00000100:00100000:2.0:1789673051.686782:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738502272 00000100:00100000:2.0:1789673051.686814:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789673051.686822:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:18641:x1876607738502272:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789673051.686902:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:18641:x1876607738502272:12345-0@lo:501:mount.lustre.0 Request processed in 80us (499us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789673051.686908:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789673051.687073:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738502272:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789673051.687088:0:18641:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789673051.687104:0:18641:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789673051.687110:0:18641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cc600/0x6c78c4f8c9966119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966120 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.687120:0:18641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cc600/0x6c78c4f8c9966119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966120 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789673051.687146:0:18641:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfc6596c000 10000000:01000000:0.0:1789673051.687150:0:18641:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789673051.687155:0:18641:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789673051.687157:0:18641:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789673051.687161:0:18641:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789673051.687163:0:18641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789673051.687184:0:18641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd600/0x6c78c4f8c996636c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.687192:0:18641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd600/0x6c78c4f8c996636c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.687202:0:18641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd600/0x6c78c4f8c996636c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673051.687215:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738502400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789673051.687239:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673051.687271:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc47a21180 going to sleep for 11 seconds 00000100:00100000:2.0:1789673051.687389:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738502400 00000100:00100000:2.0:1789673051.687393:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738502400 00000100:00100000:2.0:1789673051.687410:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789673051.687415:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+18:18641:x1876607738502400:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789673051.687423:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673051.687436:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb46aefe00/0x6c78c4f8c9966373 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c996636c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673051.687462:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb46aefe00/0x6c78c4f8c9966373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c996636c expref: 19 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673051.687473:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb46aefe00/0x6c78c4f8c9966373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c996636c expref: 19 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673051.687481:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aefe00, rc 0) 00000100:00100000:2.0:1789673051.687612:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+19:18641:x1876607738502400:12345-0@lo:101:mount.lustre.0 Request processed in 196us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673051.687619:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789673051.687856:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738502400:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789673051.687868:0:18641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd600/0x6c78c4f8c996636c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966373 expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.687878:0:18641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd600/0x6c78c4f8c996636c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9966373 expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789673051.689037:0:18641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789673051.689614:0:18641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789673051.696638:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789673051.696832:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789673051.696851:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789673051.696867:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789673051.696881:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789673051.696912:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789673051.696939:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789673051.696945:0:18641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789673051.697075:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738502528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789673051.697146:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673051.697258:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bba0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789673051.698857:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738502528 00000100:00100000:0.0:1789673051.698869:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738502528 00000100:00100000:0.0:1789673051.698958:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789673051.698969:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+19:18641:x1876607738502528:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789673051.699208:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+19:18641:x1876607738502528:12345-0@lo:501:mount.lustre.0 Request processed in 240us (2061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673051.699217:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789673051.699303:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738502528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789673051.699532:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738502656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789673051.699592:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673051.699697:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bba0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789673051.699786:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738502656 00000100:00100000:0.0:1789673051.699791:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738502656 00000100:00100000:0.0:1789673051.699851:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789673051.699859:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+19:18641:x1876607738502656:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789673051.700835:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+19:18641:x1876607738502656:12345-0@lo:503:mount.lustre.0 Request processed in 973us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673051.700846:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789673051.700991:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738502656:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789673051.701739:0:18641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789673051.701830:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738502784:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673051.701884:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673051.701919:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bba0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789673051.701999:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738502784 00000100:00100000:3.0:1789673051.702005:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738502784 00000100:00100000:3.0:1789673051.702037:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789673051.702046:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+19:18641:x1876607738502784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789673051.702513:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+19:18641:x1876607738502784:12345-0@lo:502:mount.lustre.0 Request processed in 467us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673051.702521:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789673051.702819:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738502784:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789673051.703080:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789673051.703111:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789673051.703143:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789673051.703160:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789673051.703174:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789673051.703188:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789673051.703201:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789673051.703214:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789673051.703226:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789673051.703238:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789673051.703251:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789673051.703264:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789673051.703294:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738502912:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673051.703352:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673051.703386:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bba0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789673051.703708:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738502912 00000100:00100000:3.0:1789673051.703715:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738502912 00000100:00100000:3.0:1789673051.703747:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789673051.703755:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+19:18641:x1876607738502912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789673051.703862:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+19:18641:x1876607738502912:12345-0@lo:502:mount.lustre.0 Request processed in 107us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673051.703879:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789673051.703965:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738502912:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789673051.704014:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789673051.704025:0:18641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1789673051.705068:0:18658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789673051.705078:0:18658:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789673051.705085:0:18658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673051.705087:0:18658:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789673051.705094:0:18658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789673051.705110:0:18658:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cfc815dcd40) 00000020:00000080:0.0:1789673051.705139:0:18658:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789673051.705145:0:18658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789673051.705241:0:18658:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfc6596c000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789673051.705250:0:18658:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789673051.705259:0:18658:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6c78c4f8c9966381 00010000:00010000:0.0:1789673051.709999:0:18658:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1789673051.711218:0:18658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1789673051.713409:0:18658:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1789673051.718151:0:18658:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789673051.718168:0:18658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789673051.718175:0:18658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673051.718178:0:18658:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789673051.718182:0:18658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789673051.718185:0:18658:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1789673051.718186:0:18658:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789673051.718188:0:18658:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789673051.718190:0:18658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789673051.718192:0:18658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673051.718194:0:18658:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789673051.718197:0:18658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789673051.718200:0:18658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673051.718201:0:18658:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789673051.718205:0:18658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789673051.718207:0:18658:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789673051.718209:0:18658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789673051.718212:0:18658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673051.718213:0:18658:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789673051.718216:0:18658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789673051.718218:0:18658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673051.718219:0:18658:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789673051.718223:0:18658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789673051.718262:0:18658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789673051.718267:0:18658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673051.718269:0:18658:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789673051.718288:0:18658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789673051.724941:0:18641:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789673051.725005:0:18641:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789673051.725030:0:18641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd600/0x6c78c4f8c996636c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966373 expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.725043:0:18641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd600/0x6c78c4f8c996636c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966373 expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789673051.725051:0:18641:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc6596c000 from 1 10000000:01000000:0.0:1789673051.725053:0:18641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789673051.725091:0:18641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c9966388 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.725099:0:18641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c9966388 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.725110:0:18641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c9966388 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673051.725135:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738503040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789673051.725204:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673051.725246:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb46829300 going to sleep for 11 seconds 00000100:00100000:3.0:1789673051.725428:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738503040 00000100:00100000:3.0:1789673051.725437:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738503040 00000100:00100000:3.0:1789673051.725526:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789673051.725537:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+19:18641:x1876607738503040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789673051.725553:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673051.725569:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb482e5e00/0x6c78c4f8c996638f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9966388 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673051.725592:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb482e5e00/0x6c78c4f8c996638f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9966388 expref: 20 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673051.725603:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb482e5e00/0x6c78c4f8c996638f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9966388 expref: 20 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673051.725612:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e5e00, rc 0) 00000100:00100000:3.0:1789673051.725688:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+20:18641:x1876607738503040:12345-0@lo:101:mount.lustre.0 Request processed in 123us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673051.725694:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789673051.727889:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738503040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789673051.727917:0:18641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c9966388 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996638f expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.727928:0:18641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c9966388 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996638f expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789673051.729144:0:18641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789673051.729442:0:18641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789673051.730043:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789673051.730081:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789673051.730103:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789673051.730110:0:18641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789673051.730202:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738503168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789673051.730275:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673051.730370:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb419de600 going to sleep for 11 seconds 00000100:00100000:0.0:1789673051.730432:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738503168 00000100:00100000:0.0:1789673051.730438:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738503168 00000100:00100000:0.0:1789673051.730592:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789673051.730603:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+20:18641:x1876607738503168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789673051.730771:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+20:18641:x1876607738503168:12345-0@lo:501:mount.lustre.0 Request processed in 171us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673051.730779:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789673051.730874:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738503168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789673051.730914:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738503296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789673051.730961:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673051.731272:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738503296 00000100:00100000:1.0:1789673051.731278:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738503296 00000100:00100000:1.0:1789673051.731319:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789673051.731326:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+20:18641:x1876607738503296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789673051.731419:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+20:18641:x1876607738503296:12345-0@lo:503:mount.lustre.0 Request processed in 93us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673051.731427:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789673051.731997:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45b996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789673051.732018:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738503296:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789673051.732457:0:18641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789673051.732550:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738503424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673051.732606:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673051.732639:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43103e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789673051.732798:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738503424 00000100:00100000:1.0:1789673051.732805:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738503424 00000100:00100000:1.0:1789673051.732835:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789673051.732843:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+20:18641:x1876607738503424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789673051.732954:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+20:18641:x1876607738503424:12345-0@lo:502:mount.lustre.0 Request processed in 111us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673051.732962:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789673051.733052:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738503424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789673051.733216:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789673051.733241:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789673051.733255:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789673051.733286:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789673051.733303:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789673051.733315:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789673051.733329:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789673051.733342:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789673051.733353:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789673051.733376:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789673051.733392:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789673051.733417:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738503552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673051.733454:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673051.733485:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43103e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789673051.733605:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738503552 00000100:00100000:1.0:1789673051.733610:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738503552 00000100:00100000:1.0:1789673051.733630:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789673051.733645:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+20:18641:x1876607738503552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789673051.733746:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+20:18641:x1876607738503552:12345-0@lo:502:mount.lustre.0 Request processed in 101us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673051.733753:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789673051.733848:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738503552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789673051.733887:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1789673051.733894:0:18641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789673051.735148:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789673051.735160:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673051.735163:0:18662:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789673051.735170:0:18662:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfc6596c000 00000020:00000080:1.0:1789673051.735174:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789673051.735182:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789673051.735185:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673051.735187:0:18662:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789673051.735189:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789673051.735192:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673051.735193:0:18662:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789673051.735197:0:18662:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfc6596c000 00000020:00000080:1.0:1789673051.735199:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789673051.735292:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789673051.735297:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673051.735298:0:18662:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789673051.735302:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789673051.735304:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673051.735305:0:18662:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789673051.735309:0:18662:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfc6596c000 00000020:00000080:1.0:1789673051.735312:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789673051.739484:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789673051.739546:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673051.739550:0:18662:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789673051.739555:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789673051.739560:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673051.739562:0:18662:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789673051.739567:0:18662:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfc6596c000 00000020:00000080:1.0:1789673051.739578:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789673051.739652:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789673051.739676:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789673051.739678:0:18662:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789673051.739682:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789673051.746831:0:18641:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789673051.746888:0:18641:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789673051.746914:0:18641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c9966388 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996638f expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673051.746941:0:18641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c9966388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996638f expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789673051.747009:0:18641:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789673051.747012:0:18641:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfc6596c000 10000000:01000000:2.0:1789673051.747016:0:18641:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfc6596c000 10000000:01000000:2.0:1789673051.747020:0:18641:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789673051.747025:0:18641:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfc6596c000 from 1 10000000:01000000:2.0:1789673051.747028:0:18641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789673051.747070:0:18641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb46aeee00/0x6c78c4f8c9966396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673051.747078:0:18641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfb46aeee00/0x6c78c4f8c9966396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673051.747090:0:18641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfb46aeee00/0x6c78c4f8c9966396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673051.747116:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738503680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789673051.747188:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673051.747239:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc47a21300 going to sleep for 11 seconds 00000100:00100000:1.0:1789673051.751404:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738503680 00000100:00100000:1.0:1789673051.751419:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738503680 00000100:00100000:1.0:1789673051.751483:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789673051.751495:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+20:18641:x1876607738503680:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789673051.751528:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789673051.751550:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52434000/0x6c78c4f8c996639d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9966396 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673051.751580:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52434000/0x6c78c4f8c996639d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9966396 expref: 21 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673051.751593:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52434000/0x6c78c4f8c996639d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9966396 expref: 21 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673051.751604:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434000, rc 0) 00000100:00100000:1.0:1789673051.751713:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:18641:x1876607738503680:12345-0@lo:101:mount.lustre.0 Request processed in 221us (4525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673051.751721:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789673051.755275:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738503680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789673051.755308:0:18641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfb46aeee00/0x6c78c4f8c9966396 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996639d expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673051.755322:0:18641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfb46aeee00/0x6c78c4f8c9966396 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996639d expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789673051.761328:0:18641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789673051.761711:0:18641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789673051.761955:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789673051.761984:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789673051.762001:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789673051.762017:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789673051.762038:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789673051.762053:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789673051.762067:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789673051.762081:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789673051.762107:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789673051.762123:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789673051.762155:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789673051.762172:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789673051.762186:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789673051.762217:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789673051.762232:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789673051.762247:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789673051.762262:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789673051.762275:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789673051.762288:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789673051.762304:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789673051.762319:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789673051.762333:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789673051.762347:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789673051.762374:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789673051.762392:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789673051.762406:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789673051.762434:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789673051.762449:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789673051.762461:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789673051.762475:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789673051.762489:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789673051.762503:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789673051.762516:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789673051.762529:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789673051.762542:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789673051.762555:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789673051.762568:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789673051.762588:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789673051.762593:0:18641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789673051.762700:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738503808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789673051.762777:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673051.762826:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb419ac540 going to sleep for 11 seconds 00000100:00100000:3.0:1789673051.762861:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738503808 00000100:00100000:3.0:1789673051.762868:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738503808 00000100:00100000:3.0:1789673051.762928:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789673051.762937:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:18641:x1876607738503808:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789673051.763074:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:18641:x1876607738503808:12345-0@lo:501:mount.lustre.0 Request processed in 137us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673051.763082:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789673051.763802:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738503808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789673051.763846:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738503936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789673051.763893:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673051.763927:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc65c23e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789673051.764016:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738503936 00000100:00100000:1.0:1789673051.764023:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738503936 00000100:00100000:1.0:1789673051.764066:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789673051.764074:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:18641:x1876607738503936:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789673051.764713:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:18641:x1876607738503936:12345-0@lo:503:mount.lustre.0 Request processed in 638us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673051.764732:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789673051.765683:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738503936:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789673051.766117:0:18641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789673051.766201:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738504064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673051.766256:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673051.766296:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43435a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789673051.766394:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738504064 00000100:00100000:0.0:1789673051.766401:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738504064 00000100:00100000:0.0:1789673051.766444:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789673051.766451:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:18641:x1876607738504064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789673051.766636:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:18641:x1876607738504064:12345-0@lo:502:mount.lustre.0 Request processed in 185us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673051.766644:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789673051.766706:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738504064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789673051.766863:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789673051.766884:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789673051.766896:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789673051.766907:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789673051.766917:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789673051.766928:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789673051.766940:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789673051.766950:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789673051.766961:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789673051.766979:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789673051.766990:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789673051.767014:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789673051.767025:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789673051.767036:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789673051.767046:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789673051.767057:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789673051.767068:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789673051.767078:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789673051.767088:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789673051.767099:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789673051.767109:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789673051.767120:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789673051.767130:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789673051.767141:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789673051.767151:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1789673051.767161:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1789673051.767172:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1789673051.767193:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1789673051.767204:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1789673051.767215:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1789673051.767225:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1789673051.767236:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1789673051.767246:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1789673051.767257:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1789673051.767267:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1789673051.767278:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1789673051.767288:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1789673051.767299:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1789673051.767309:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1789673051.767319:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1789673051.767330:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1789673051.767341:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1789673051.767359:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1789673051.770852:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1789673051.770874:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1789673051.770887:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1789673051.770900:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1789673051.770915:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1789673051.770979:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738504192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789673051.771067:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673051.771115:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb46829840 going to sleep for 11 seconds 00000100:00100000:2.0:1789673051.772655:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738504192 00000100:00100000:2.0:1789673051.772683:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738504192 00000100:00100000:2.0:1789673051.772742:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789673051.772753:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:18641:x1876607738504192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673051.772927:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:18641:x1876607738504192:12345-0@lo:502:mount.lustre.0 Request processed in 176us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673051.772935:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789673051.773434:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738504192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789673051.773724:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1789673051.773755:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1789673051.773792:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738504320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789673051.773848:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673051.773884:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb46829840 going to sleep for 11 seconds 00000100:00100000:2.0:1789673051.778246:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738504320 00000100:00100000:2.0:1789673051.778265:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738504320 00000100:00100000:2.0:1789673051.778346:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789673051.778357:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:18641:x1876607738504320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673051.778583:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:18641:x1876607738504320:12345-0@lo:502:mount.lustre.0 Request processed in 228us (4735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673051.778591:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789673051.778740:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738504320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789673051.778851:0:18641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789673051.778865:0:18641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789673051.784914:0:18668:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789673051.784938:0:18668:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cfc74594d40) 00000020:00000080:2.0:1789673051.784966:0:18668:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1789673051.785063:0:18668:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfc6596c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789673051.785067:0:18668:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfc6596c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789673051.785069:0:18668:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfc6596c000 3 00010000:00080000:2.0:1789673051.785102:0:18668:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfc7f512800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.150@tcp at head 00010000:00010000:2.0:1789673051.789268:0:18668:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1789673051.789555:0:18668:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789673051.789611:0:18668:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789673051.789627:0:18668:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6c78c4f8c99663ab 00000100:00080000:2.0:1789673051.789638:0:18668:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789673051.789651:0:18668:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cfc7f512800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789673051.789708:0:18668:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7f716a00 x1876607738504448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789673051.789733:0:18668:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789673051.799773:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876607738504448:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789673051.799869:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673051.800440:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738504448 00000100:00100000:3.0:1789673051.800450:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738504448 00000100:00100000:3.0:1789673051.800491:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789673051.800692:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1876607738504448:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789673051.800730:0:17140:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:3.0:1789673051.800778:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6c78c4f8c99663b2 00000004:00100000:3.0:1789673051.800793:0:17140:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789673051.800830:0:17140:0:(import.c:65:import_set_state_nolock()) ffff8cfb47a38800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789673051.800894:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1876607738504448:12345-0@lo:38:llog_process_th.0 Request processed in 395us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673051.800902:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789673051.800955:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc7f716a00 x1876607738504448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789673061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673051.800967:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789673051.800975:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789673051.800983:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789673051.800987:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789673051.801003:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f512800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789673051.801009:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1876607738504448:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789673051.805164:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789673051.805172:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789673051.805175:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789673051.805178:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789673051.805206:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789673051.805210:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789673051.805213:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789673051.805216:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789673051.805266:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738504832:0@lo:400:kworker.0 00000100:00100000:0.0:1789673051.805355:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673051.805408:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789673051.805426:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738504960:0@lo:400:kworker.0 00000100:00100000:0.0:1789673051.805462:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673051.805645:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738504832 00000100:00100000:0.0:1789673051.805653:0:17882:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738504832 00000100:00100000:0.0:1789673051.805724:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789673051.805734:0:17882:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738504832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673051.805913:0:17882:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738504832:12345-0@lo:400:kworker.0 Request processed in 180us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673051.805921:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789673051.805952:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738504960 00000100:00100000:0.0:1789673051.805956:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738504960 00000100:00100000:0.0:1789673051.805979:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789673051.805985:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738504960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673051.806013:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738504960:12345-0@lo:400:kworker.0 Request processed in 29us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673051.806019:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789673051.806057:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc462de300 x1876607738504960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789673051.806072:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738504960:0@lo:400:kworker.0 00000100:00100000:0.0:1789673051.806082:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738504832:0@lo:400:kworker.0 00000100:00100000:3.0:1789673051.806169:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738504576:0@lo:400:kworker.0 00000100:00100000:3.0:1789673051.806199:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673051.806232:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789673051.806239:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738504704:0@lo:400:kworker.0 00000100:00100000:3.0:1789673051.806263:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673051.806298:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738504704 00000100:00100000:3.0:1789673051.806302:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738504704 00000100:00100000:3.0:1789673051.806327:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789673051.806334:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738504704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673051.806383:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738504704:12345-0@lo:400:kworker.0 Request processed in 49us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673051.806389:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789673051.806417:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc462dd180 x1876607738504704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673051.806427:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738504704:0@lo:400:kworker.0 00000020:01000004:3.0:1789673051.807357:0:18668:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789673051.807389:0:18668:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8cfc7c67b380) 00000020:00000080:3.0:1789673051.807417:0:18668:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1789673051.807688:0:18668:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfc6596c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789673051.807693:0:18668:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfc6596c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789673051.807696:0:18668:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfc6596c000 3 00010000:00080000:3.0:1789673051.807729:0:18668:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfb47a3a800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.150@tcp at head 00000100:00100000:0.0:1789673051.808998:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738504576 00000100:00100000:0.0:1789673051.809009:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738504576 00000100:00100000:0.0:1789673051.809067:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789673051.809078:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738504576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673051.809188:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738504576:12345-0@lo:400:kworker.0 Request processed in 113us (2987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673051.809196:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789673051.809244:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738504576:0@lo:400:kworker.0 00010000:00010000:3.0:1789673051.816003:0:18668:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1789673051.816238:0:18668:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789673051.816312:0:18668:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789673051.816327:0:18668:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x6c78c4f8c99663c0 00000100:00080000:3.0:1789673051.816339:0:18668:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789673051.816354:0:18668:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8cfb47a3a800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789673051.819630:0:18668:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7c406a00 x1876607738505088/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789673051.819690:0:18668:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789673051.819797:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673051.819803:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789673051.819806:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673051.819810:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789673051.819814:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673051.819817:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789673051.819819:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673051.819823:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789673051.821158:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1876607738505088:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789673051.821249:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789673051.821637:0:18668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:1.0:1789673051.822145:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738505088 00000100:00100000:1.0:1789673051.822156:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738505088 00000100:00100000:1.0:1789673051.822207:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789673051.822216:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1876607738505088:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789673051.822251:0:17140:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:1.0:1789673051.822296:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x6c78c4f8c99663c7 00000004:00100000:1.0:1789673051.822313:0:17140:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789673051.822352:0:17140:0:(import.c:65:import_set_state_nolock()) ffff8cfb4757f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789673051.822438:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1876607738505088:12345-0@lo:38:llog_process_th.0 Request processed in 221us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673051.822445:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:2.0:1789673051.822744:0:18641:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789673051.824697:0:18641:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789673051.824731:0:18641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb46aeee00/0x6c78c4f8c9966396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996639d expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673051.824758:0:18641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfb46aeee00/0x6c78c4f8c9966396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996639d expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789673051.824915:0:18641:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789673051.824917:0:18641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789673051.824919:0:18641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789673051.824920:0:18641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789673051.824922:0:18641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789673051.824923:0:18641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789673051.824924:0:18641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789673051.824927:0:18641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789673051.824928:0:18641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789673051.824932:0:18641:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789673051.824935:0:18641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789673051.824936:0:18641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789673051.824937:0:18641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789673051.824938:0:18641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789673051.824939:0:18641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789673051.824941:0:18641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789673051.824942:0:18641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789673051.824943:0:18641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789673051.824944:0:18641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789673051.824977:0:18641:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789673051.824999:0:18641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f714700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738505216:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789673051.825073:0:18641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673051.825113:0:18641:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43435840 going to sleep for 11 seconds 00010000:00080000:2.0:1789673051.825170:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cfc7c406a00 x1876607738505088/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789673061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673051.825183:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789673051.825193:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789673051.825201:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789673051.825207:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789673051.825217:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb47a3a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789673051.825225:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1876607738505088:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789673051.825378:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738505216 00000100:00100000:3.0:1789673051.825386:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738505216 00000100:00100000:3.0:1789673051.825453:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789673051.825464:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:18641:x1876607738505216:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789673051.825490:0:17132:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789673051.825504:0:17132:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789673051.839907:0:17132:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789673051.839931:0:17132:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789673051.840389:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:18641:x1876607738505216:12345-0@lo:253:mount.lustre.0 Request processed in 14920us (15308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673051.840403:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789673051.840524:0:18641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f714700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:18641:1876607738505216:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789673051.840543:0:18641:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789673051.840563:0:18641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789673051.840565:0:18641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789673051.840566:0:18641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789673051.840568:0:18641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789673051.840569:0:18641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789673051.840571:0:18641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789673051.840572:0:18641:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789673051.840574:0:18641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789673051.840575:0:18641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789673051.840595:0:18641:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789673051.843974:0:17154:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789673051.843985:0:17154:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789673051.844019:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c99663ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.844042:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfb482e5c00/0x6c78c4f8c9966318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9966311 expref: 20 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.844051:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc52435c00/0x6c78c4f8c9966326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c996631f expref: 20 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.844059:0:17154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c99663ce lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.844107:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc52435c00/0x6c78c4f8c9966326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c996631f expref: 20 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.844125:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfc52435c00/0x6c78c4f8c9966326 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c996631f expref: 20 pid: 17132 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673051.844141:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876607738505344:0@lo:104: 00000100:00100000:0.0:1789673051.844226:0:17154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789673051.844302:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfb482e5c00/0x6c78c4f8c9966318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9966311 expref: 20 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.844311:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfb482e5c00/0x6c78c4f8c9966318 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9966311 expref: 20 pid: 17133 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673051.844338:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876607738505472:0@lo:104: 00000100:00100000:0.0:1789673051.844381:0:17154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673051.844403:0:17154:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb46829000 going to sleep for 11 seconds 00000100:00100000:0.0:1789673051.844437:0:17121:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789673051.844455:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738505344 00000100:00100000:0.0:1789673051.844462:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738505344 00000100:00100000:0.0:1789673051.844590:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738505472 00000100:00100000:0.0:1789673051.844595:0:17121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738505472 00000100:00100000:0.0:1789673051.844616:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789673051.844624:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+4:17154:x1876607738505344:12345-0@lo:104: 00010000:00010000:0.0:1789673051.844638:0:17121:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c996631f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9966326 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.845026:0:17121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789673051.845033:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+4:17154:x1876607738505344:12345-0@lo:104: Request processed in 410us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673051.845042:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789673051.845063:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789673051.845070:0:17121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c7db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+3:17154:x1876607738505472:12345-0@lo:104: 00010000:00010000:0.0:1789673051.845079:0:17121:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9966318 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.845115:0:17121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789673051.845121:0:17121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c7db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+3:17154:x1876607738505472:12345-0@lo:104: Request processed in 52us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673051.845127:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789673051.845173:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789673051.845189:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c996631f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9966326 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.845197:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435e00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789673051.845201:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c996631f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9966326 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.845210:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c996631f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9966326 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789673051.845218:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c996631f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9966326 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789673051.845224:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789673051.845257:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c996631f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9966326 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.845264:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789673051.845288:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c996631f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9966326 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.845295:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc52435e00/0x6c78c4f8c996631f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9966326 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.845310:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789673051.845314:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9966318 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.845319:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd000 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789673051.845321:0:17127:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9966318 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.845339:0:17127:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9966318 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789673051.845346:0:17127:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9966318 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789673051.845352:0:17127:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789673051.845377:0:17127:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966311 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9966318 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.845384:0:17127:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789673051.845391:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966311 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9966318 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.845397:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd000/0x6c78c4f8c9966311 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9966318 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.845410:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673051.845412:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673051.845413:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673051.845420:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673051.845443:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738505600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789673051.845476:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673051.845501:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789673051.845507:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738505728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789673051.845976:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673051.846035:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738505600 00000100:00100000:0.0:1789673051.846040:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738505600 00010000:00010000:0.0:1789673051.846073:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc52435c00/0x6c78c4f8c9966326 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c996631f expref: 21 pid: 17132 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673051.846099:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738505728 00000100:00100000:0.0:1789673051.846102:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738505728 00010000:00010000:0.0:1789673051.846114:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfb482e5c00/0x6c78c4f8c9966318 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9966311 expref: 22 pid: 17133 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673051.846127:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789673051.846133:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:3637:x1876607738505600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789673051.846144:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789673051.846149:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc52435c00/0x6c78c4f8c9966326 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c996631f expref: 22 pid: 17132 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.846160:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc52435c00/0x6c78c4f8c9966326 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c996631f expref: 22 pid: 17132 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.846175:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789673051.846266:0:17124:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789673051.846277:0:17124:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789673051.846393:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:3637:x1876607738505600:12345-0@lo:103:ldlm_bl.0 Request processed in 259us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673051.846400:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789673051.846418:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789673051.846424:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc818f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:3637:x1876607738505728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789673051.846433:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789673051.846437:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfb482e5c00/0x6c78c4f8c9966318 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9966311 expref: 21 pid: 17133 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.846445:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfb482e5c00/0x6c78c4f8c9966318 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9966311 expref: 21 pid: 17133 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.846468:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c99663ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.846477:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c99663ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789673051.846491:0:17123:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002506921s 00010000:00010000:0.0:1789673051.846496:0:17123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c99663ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.846520:0:17123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c99663ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.846528:0:17123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c99663ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.846534:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c99663ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.846540:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc200 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789673051.846544:0:17123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c99663ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.846551:0:17123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c99663ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.846559:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c99663ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.846568:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789673051.846594:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc818f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:3637:x1876607738505728:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673051.846606:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789673051.846697:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc52435c00/0x6c78c4f8c9966326 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c996631f expref: 20 pid: 17132 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673051.846713:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876607738505344:0@lo:104: 00010000:00010000:0.0:1789673051.846725:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfb482e5c00/0x6c78c4f8c9966318 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9966311 expref: 19 pid: 17133 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673051.846734:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462de300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876607738505472:0@lo:104: 00010000:00010000:0.0:1789673051.846749:0:17154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c99663ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.846757:0:17154:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c99663ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.846763:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c99663ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673051.846769:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c99663ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673051.853291:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738505600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789673051.853763:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738505728:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1789673051.854335:0:18641:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789673051.858491:0:18641:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789673051.858632:0:18641:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789673051.858949:0:18641:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789673051.859006:0:18641:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789673051.859031:0:18641:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789673051.859056:0:18641:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789673051.867445:0:18641:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789673051.869394:0:18641:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789673052.227925:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789673052.738979:0:18723:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789673052.739412:0:18723:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789673053.255206:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789673053.319555:0:17135:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789673053.319564:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfb46b12800 from 9 10000000:01000000:3.0:1789673053.319570:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789673053.319625:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5c00/0x6c78c4f8c99663d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673053.319653:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5c00/0x6c78c4f8c99663d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673053.319886:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5c00/0x6c78c4f8c99663d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673053.319913:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738505856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789673053.319985:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673053.320075:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d839540 going to sleep for 11 seconds 00000100:00100000:2.0:1789673053.320136:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738505856 00000100:00100000:2.0:1789673053.320145:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738505856 00000100:00100000:2.0:1789673053.320239:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789673053.320250:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+19:17135:x1876607738505856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789673053.320264:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673053.320292:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c99663dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99663d5 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673053.320319:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c99663dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99663d5 expref: 20 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673053.320341:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c99663dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99663d5 expref: 20 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673053.320351:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aefa00, rc 0) 00000100:00100000:2.0:1789673053.320406:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+20:17135:x1876607738505856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673053.320414:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789673053.320506:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738505856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789673053.320522:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5c00/0x6c78c4f8c99663d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99663dc expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673053.320531:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5c00/0x6c78c4f8c99663d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99663dc expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673053.320581:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738505984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789673053.320610:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673053.320906:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc57be9000 going to sleep for 11 seconds 00000100:00100000:3.0:1789673053.320935:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738505984 00000100:00100000:3.0:1789673053.320939:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738505984 00000100:00100000:3.0:1789673053.320964:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789673053.320971:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+20:17135:x1876607738505984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789673053.320984:0:17133:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789673053.321002:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789673053.321005:0:17133:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1789673053.321081:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+20:17135:x1876607738505984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673053.321089:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789673053.321166:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738505984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789673053.321220:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789673053.321227:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5c00/0x6c78c4f8c99663d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99663dc expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673053.321235:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5c00/0x6c78c4f8c99663d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99663dc expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789673053.321245:0:17135:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789673053.321251:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfc7f765000 from 9 10000000:01000000:1.0:1789673053.321254:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789673053.321270:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52435600/0x6c78c4f8c99663e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673053.321344:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc52435600/0x6c78c4f8c99663e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673053.321354:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc52435600/0x6c78c4f8c99663e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673053.321368:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738506112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789673053.321392:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673053.321445:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc57be9000 going to sleep for 11 seconds 00000100:00100000:3.0:1789673053.321535:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738506112 00000100:00100000:3.0:1789673053.321539:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738506112 00000100:00100000:3.0:1789673053.321591:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789673053.321598:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+20:17135:x1876607738506112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789673053.321606:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673053.321616:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb482e4600/0x6c78c4f8c99663ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99663e3 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673053.321641:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb482e4600/0x6c78c4f8c99663ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99663e3 expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673053.321651:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb482e4600/0x6c78c4f8c99663ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99663e3 expref: 21 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673053.321686:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e4600, rc 0) 00000100:00100000:3.0:1789673053.321709:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:17135:x1876607738506112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673053.321715:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789673053.321769:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738506112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789673053.321780:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc52435600/0x6c78c4f8c99663e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99663ea expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673053.321788:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc52435600/0x6c78c4f8c99663e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99663ea expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673053.321830:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738506240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789673053.321858:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673053.321991:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc57be9000 going to sleep for 11 seconds 00000100:00100000:2.0:1789673053.322017:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738506240 00000100:00100000:2.0:1789673053.322027:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738506240 00000100:00100000:2.0:1789673053.322048:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789673053.322055:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:17135:x1876607738506240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789673053.322066:0:17131:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789673053.322077:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789673053.322080:0:17131:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789673053.322147:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:17135:x1876607738506240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 93us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673053.322154:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789673053.322195:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738506240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789673053.322236:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789673053.322242:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52435600/0x6c78c4f8c99663e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99663ea expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673053.322248:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc52435600/0x6c78c4f8c99663e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99663ea expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673054.280914:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673055.299966:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673056.072784:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738506368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789673056.072885:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673056.073041:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738506368 00000100:00100000:3.0:1789673056.073053:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738506368 00000100:00100000:3.0:1789673056.073104:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789673056.073115:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738506368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789673056.073171:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789673056.073230:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738506368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673056.073238:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789673056.073397:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738506368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789673056.073872:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738506496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789673056.073914:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673056.074005:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738506496 00000100:00100000:1.0:1789673056.074012:0:17882:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738506496 00000100:00100000:1.0:1789673056.074056:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789673056.074066:0:17882:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738506496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789673056.074092:0:17882:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789673056.074157:0:17882:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738506496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673056.074164:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789673056.074426:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738506496:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789673056.333387:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789673057.029651:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1789673057.091928:0:18407:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673057.091936:0:18407:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789673057.091940:0:18407:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673057.091943:0:18407:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789673057.091973:0:18407:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673057.091977:0:18407:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789673057.091980:0:18407:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673057.091983:0:18407:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789673057.092028:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738506752:0@lo:400:kworker.0 00000100:00100000:1.0:1789673057.092114:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673057.092178:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738507264:0@lo:400:kworker.0 00000100:00100000:1.0:1789673057.092206:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673057.092231:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789673057.092236:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3638:1876607738506624:0@lo:400:kworker.0 00000100:00100000:1.0:1789673057.092877:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673057.092914:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738507136:0@lo:400:kworker.0 00000100:00100000:1.0:1789673057.093325:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673057.093368:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738506880:0@lo:400:kworker.0 00000100:00100000:1.0:1789673057.093394:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673057.093779:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738507392:0@lo:400:kworker.0 00000100:00100000:1.0:1789673057.093811:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673057.093831:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789673057.093836:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738507008:0@lo:400:kworker.0 00000100:00100000:1.0:1789673057.093861:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673057.093887:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738506752 00000100:00100000:1.0:1789673057.093892:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738507008 00000100:00100000:1.0:1789673057.093897:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738507008 00000100:00100000:3.0:1789673057.093898:0:17882:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738506752 00000100:00100000:2.0:1789673057.093987:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738506624 00000100:00100000:2.0:1789673057.093992:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738506624 00000100:00100000:2.0:1789673057.094032:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789673057.094041:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:3638:x1876607738506624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789673057.094111:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:3638:x1876607738506624:12345-0@lo:400:kworker.0 Request processed in 70us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673057.094245:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789673057.094332:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789673057.094395:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3638:1876607738506624:0@lo:400:kworker.0 00000100:00100000:3.0:1789673057.094563:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789673057.094572:0:17882:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738506752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673057.094621:0:17882:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738506752:12345-0@lo:400:kworker.0 Request processed in 50us (2506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673057.094627:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789673057.094681:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738507008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673057.094724:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738507008:12345-0@lo:400:kworker.0 Request processed in 69us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673057.094731:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789673057.094753:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738507264 00000100:00100000:1.0:1789673057.094758:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738507264 00000100:00100000:0.0:1789673057.095113:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738507008:0@lo:400:kworker.0 00000100:00100000:0.0:1789673057.095820:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738507136 00000100:00100000:0.0:1789673057.095829:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738507136 00000100:00100000:0.0:1789673057.095871:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738506880 00000100:00100000:0.0:1789673057.095875:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738506880 00000100:00100000:0.0:1789673057.095888:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738507392 00000100:00100000:0.0:1789673057.095891:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738507392 00000100:00100000:1.0:1789673057.096046:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789673057.096056:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738507136:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789673057.096115:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789673057.096125:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789673057.096160:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462e8380 x1876607738507136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673057.096174:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876607738507136:0@lo:400:kworker.0 00000100:00100000:3.0:1789673057.096188:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738506752:0@lo:400:kworker.0 00000100:00100000:1.0:1789673057.096388:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876607738507136:12345-0@lo:400:kworker.0 Request processed in 332us (3062us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673057.096396:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789673057.096414:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789673057.096430:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738506880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673057.096701:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738506880:12345-0@lo:400:kworker.0 Request processed in 271us (3304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673057.096708:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789673057.096722:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789673057.096728:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738507264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673057.096771:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738507264:12345-0@lo:400:kworker.0 Request processed in 44us (4564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673057.096777:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789673057.097337:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462e9c00 x1876607738506880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673057.097366:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738506880:0@lo:400:kworker.0 00010000:00080000:3.0:1789673057.098109:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462e8a80 x1876607738507264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673057.098123:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738507264:0@lo:400:kworker.0 00000100:00100000:0.0:1789673057.099118:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789673057.099135:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738507392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673057.099249:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738507392:12345-0@lo:400:kworker.0 Request processed in 118us (5435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673057.099258:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789673057.099368:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462eb100 x1876607738507392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673057.099383:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738507392:0@lo:400:kworker.0 00010000:00010000:1.0:1789673057.349251:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673058.373130:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789673059.165357:0:19013:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789673059.403922:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789673059.845441:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789673060.036809:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789673045/real 1789673045] req@ffff8cfc7d8df480 x1876607738501248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673060 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673060.036847:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfc7d8df480 x1876607738501248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673060 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673060.036857:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789673045/real 1789673045] req@ffff8cfc7d8dd180 x1876607738501120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673060 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673060.036869:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfc7d8dd180 x1876607738501120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673060 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789673060.036891:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc6173d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789673060.036912:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789673060.036917:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738501248:0@lo:8:kworker.0 00000100:00080000:2.0:1789673060.036923:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc44208800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789673060.036929:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789673060.036933:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738501120:0@lo:8:kworker.0 00000100:00100000:2.0:1789673060.037093:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1789673060.038969:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673060.038976:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789673060.038979:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673060.038982:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789673060.040860:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738507648:0@lo:400:kworker.0 00000100:00100000:0.0:1789673060.040961:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673060.041034:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789673060.041043:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738507776:0@lo:400:kworker.0 00000100:00100000:0.0:1789673060.041071:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673060.041118:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738507648 00000100:00100000:0.0:1789673060.041129:0:17882:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738507648 00000100:00100000:0.0:1789673060.041190:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789673060.041202:0:17882:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738507648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673060.041291:0:17882:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738507648:12345-0@lo:400:kworker.0 Request processed in 91us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673060.041300:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789673060.041346:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738507648:0@lo:400:kworker.0 00000100:00100000:2.0:1789673060.041890:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738507776 00000100:00100000:2.0:1789673060.041898:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738507776 00000100:00100000:2.0:1789673060.041941:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789673060.041948:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738507776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789673060.042004:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738507776:12345-0@lo:400:kworker.0 Request processed in 57us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673060.042010:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789673060.042060:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462e8e00 x1876607738507776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673060.042071:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738507776:0@lo:400:kworker.0 00000100:00100000:2.0:1789673060.042091:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738507904:0@lo:400:kworker.0 00000100:00100000:2.0:1789673060.042120:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673060.042144:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3635:1876607738507520:0@lo:400:kworker.0 00000100:00100000:2.0:1789673060.042170:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673060.042189:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738507520 00000100:00100000:2.0:1789673060.042193:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738507520 00000100:00100000:2.0:1789673060.042231:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789673060.042238:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:3635:x1876607738507520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789673060.042268:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:3635:x1876607738507520:12345-0@lo:400:kworker.0 Request processed in 30us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673060.042274:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789673060.042329:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3635:1876607738507520:0@lo:400:kworker.0 00000100:00100000:0.0:1789673060.042640:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738507904 00000100:00100000:0.0:1789673060.042646:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738507904 00000100:00100000:0.0:1789673060.042695:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789673060.042702:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738507904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673060.042743:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738507904:12345-0@lo:400:kworker.0 Request processed in 42us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673060.042749:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789673060.043103:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673060.043109:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789673060.043113:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cfc44208800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789673060.043119:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 523 00000100:00080000:1.0:1789673060.043124:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789673060.043132:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cfc44208800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789673060.043173:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc462e8a80 x1876607738508032/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789673060.043202:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673060.043206:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789673060.043208:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cfc6173d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789673060.043211:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 523 00000100:00080000:1.0:1789673060.043224:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789673060.043229:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cfc6173d000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789673060.043242:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc462e9c00 x1876607738508160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789673060.043254:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738508032:0@lo:8:kworker.0 00000100:00100000:1.0:1789673060.043278:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738508288:0@lo:400:kworker.0 00000100:00100000:0.0:1789673060.043293:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673060.043701:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738508032 00000100:00100000:2.0:1789673060.043709:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738508032 00000100:00100000:2.0:1789673060.043737:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789673060.043742:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876607738508032:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789673060.043771:0:18646:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:2.0:1789673060.043823:0:18646:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c78c4f8c99663f1 00000100:00100000:1.0:1789673060.043873:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673060.043917:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738508288 00000100:00100000:1.0:1789673060.043920:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738508288 00000100:00100000:1.0:1789673060.043952:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789673060.043959:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738508288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673060.044009:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1876607738508288:12345-0@lo:400:kworker.0 Request processed in 52us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673060.044016:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789673060.044055:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462ea680 x1876607738508288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673060.044069:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1876607738508288:0@lo:400:kworker.0 00000100:00100000:1.0:1789673060.044112:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789673060.044121:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738508416:0@lo:400:kworker.0 00000100:00100000:1.0:1789673060.044148:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673060.044175:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738508416 00000100:00100000:1.0:1789673060.044179:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738508416 00000100:00100000:1.0:1789673060.044207:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789673060.044223:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738508416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673060.044256:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738508416:12345-0@lo:400:kworker.0 Request processed in 44us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673060.044263:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789673060.044279:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789673060.044297:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462ea680 x1876607738508416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673060.044330:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738508416:0@lo:400:kworker.0 00000100:00100000:1.0:1789673060.044373:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738508544:0@lo:400:kworker.0 00000100:00100000:1.0:1789673060.044396:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673060.044419:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738508544 00000100:00100000:1.0:1789673060.044423:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738508544 00000100:00100000:1.0:1789673060.044450:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789673060.044457:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738508544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673060.044491:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738508544:12345-0@lo:400:kworker.0 Request processed in 34us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673060.044497:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1789673060.044510:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789673060.044524:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462ea680 x1876607738508544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673060.044534:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738508544:0@lo:400:kworker.0 00000100:00100000:0.0:1789673060.045632:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738508160:0@lo:8:kworker.0 00002000:00100000:2.0:1789673060.045797:0:18646:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8cfb467e4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789673060.045804:0:18646:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1789673060.045807:0:18646:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789673060.046009:0:18646:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789673060.046044:0:18646:0:(import.c:65:import_set_state_nolock()) ffff8cfb467e0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789673060.046109:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1876607738508032:12345-0@lo:8:kworker.0 Request processed in 2364us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673060.046118:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789673060.046180:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738507904:0@lo:400:kworker.0 00000100:00100000:0.0:1789673060.047209:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789673060.047293:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462e8a80 x1876607738508032/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789673080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789673060.047351:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789673060.047364:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789673060.047375:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789673060.047384:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789673060.047387:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc44208800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789673060.047511:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789673060.047520:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738508032:0@lo:8:kworker.0 00000100:00100000:2.0:1789673060.047542:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738508160 00000100:00100000:2.0:1789673060.047551:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738508160 00000100:00100000:2.0:1789673060.047582:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000004:00080000:1.0:1789673060.047650:0:17880:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789673060.047770:0:17880:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 537963111098ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789673060.047778:0:17880:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789673060.049725:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1876607738508160:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789673060.049757:0:18648:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789673060.050075:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738508672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789673060.050162:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789673060.050237:0:17881:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789673060.050264:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17881:1876607738508800:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789673060.050427:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673060.050452:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bc5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789673060.050504:0:18647:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789673060.050512:0:18647:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789673060.050629:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738508800 00000100:00100000:3.0:1789673060.050638:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738508800 00000100:00100000:3.0:1789673060.051236:0:19053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789673060.051249:0:19053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17881:x1876607738508800:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789673060.051627:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738508672 00000100:00100000:3.0:1789673060.051635:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738508672 00000100:00100000:3.0:1789673060.051697:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789673060.051705:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3635:x1876607738508672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789673060.051725:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000004:00080000:0.0:1789673060.053466:0:17872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00080000:1.0:1789673060.053676:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789673060.053863:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3635:x1876607738508672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2153us (3695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673060.053887:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:0.0:1789673060.056595:0:19053:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789673060.056611:0:19053:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789673060.056744:0:19053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17881:x1876607738508800:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5492us (6435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673060.056757:0:19053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789673060.056824:0:17881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7c407b80 x1876607738508800/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789673076 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789673060.056843:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17881:1876607738508800:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789673060.056860:0:17881:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789673060.056913:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17881:1876607738508928:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789673060.056952:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673060.056976:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb419ac480 going to sleep for 11 seconds 00000100:00100000:0.0:1789673060.056999:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738508928 00000100:00100000:0.0:1789673060.057006:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738508928 00000100:00100000:0.0:1789673060.057198:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789673060.057210:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17881:x1876607738508928:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789673060.057266:0:18647:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00010000:00080000:1.0:1789673060.062730:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7c405f80 x1876607738508672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789673076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673060.062768:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738508672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789673060.069269:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17881:x1876607738508928:12345-0@lo:5:osp-pre-0-1.0 Request processed in 12045us (12300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673060.069288:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789673060.069396:0:17881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462df800 x1876607738508928/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789673076 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789673060.069415:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17881:1876607738508928:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789673060.069434:0:17881:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789673060.069495:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17881:1876607738509056:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789673060.069567:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673060.069599:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb419ac480 going to sleep for 11 seconds 00000100:00100000:3.0:1789673060.071611:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738509056 00000100:00100000:3.0:1789673060.071631:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738509056 00000100:00100000:3.0:1789673060.071715:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789673060.071728:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17881:x1876607738509056:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789673060.071784:0:18646:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1789673060.071794:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1876607738508160:12345-0@lo:8:kworker.0 Request processed in 22080us (24588us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789673060.071805:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789673060.071860:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc6173d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789673060.071867:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789673060.071871:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738508160:0@lo:8:kworker.0 00000001:00080000:3.0:1789673060.127119:0:18642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789673060.127141:0:18642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789673060.127635:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17881:x1876607738509056:12345-0@lo:5:osp-pre-0-1.0 Request processed in 55905us (58061us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789673060.127733:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789673060.127872:0:17881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462df800 x1876607738509056/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789673076 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673060.127886:0:17881:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789673060.127894:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17881:1876607738509056:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789673060.127920:0:17881:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1789673060.127983:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17881:1876607738509184:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789673060.128030:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673060.133468:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc434353c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789673060.134533:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738509184 00000100:00100000:0.0:1789673060.134548:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738509184 00000100:00100000:0.0:1789673060.134609:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789673060.134620:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17881:x1876607738509184:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789673060.134762:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17881:x1876607738509184:12345-0@lo:900:osp-pre-0-1.0 Request processed in 144us (6731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673060.134771:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789673060.135006:0:17881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7f715f80 x1876607738509184/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789673076 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673060.135027:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17881:1876607738509184:0@lo:900:osp-pre-0-1.0 00000020:00000004:0.0:1789673060.183382:0:19066:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789673060.183741:0:19066:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789673060.423092:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789673061.190935:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789673061.190961:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738509312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789673061.191039:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673061.191091:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738509312 00000100:00100000:1.0:1789673061.191100:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738509312 00000100:00100000:1.0:1789673061.191149:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789673061.191159:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738509312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789673061.191209:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789673061.191255:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738509312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673061.191263:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789673061.191312:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738509312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789673061.193283:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738509440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789673061.193354:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673061.194127:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738509440 00000100:00100000:2.0:1789673061.194138:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738509440 00000100:00100000:2.0:1789673061.194190:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789673061.194211:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738509440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789673061.194250:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789673061.194315:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738509440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673061.194322:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789673061.194375:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738509440:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1789673061.263519:0:19117:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789673061.263770:0:19117:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789673061.443756:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789673062.085135:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789673042/real 1789673042] req@ffff8cfc7d8dd500 x1876607738498816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673062 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673062.085165:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfc7d8dd500 x1876607738498816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673062 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673062.085188:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789673042/real 1789673042] req@ffff8cfc7d8ded80 x1876607738498944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673062 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673062.085202:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cfc7d8ded80 x1876607738498944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789673062 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789673062.085221:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb4693c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789673062.085248:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789673062.085252:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738498816:0@lo:8:kworker.0 00000100:00080000:3.0:1789673062.085258:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789673062.085264:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789673062.085267:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738498944:0@lo:8:kworker.0 00000100:00080000:0.0:1789673062.085395:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789673062.085400:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789673062.085403:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cfb4693c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789673062.085408:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:0.0:1789673062.085414:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789673062.085425:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cfb4693c000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789673062.085446:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc462ddf80 x1876607738509696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789673062.085458:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789673062.085461:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789673062.085463:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789673062.085466:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:0.0:1789673062.085469:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789673062.085473:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfc458c7800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789673062.085486:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc462df800 x1876607738509824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789673062.085529:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789673062.085532:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789673062.085534:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cfc6173d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789673062.085538:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 537 00000100:00080000:0.0:1789673062.085540:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789673062.085545:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cfc6173d000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:0.0:1789673062.085556:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc462dd180 x1876607738510208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789673062.085601:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738510080:0@lo:400:kworker.0 00000100:00100000:0.0:1789673062.085689:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673062.085723:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789673062.085730:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738509952:0@lo:400:kworker.0 00000100:00100000:0.0:1789673062.085757:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673062.085773:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738510592:0@lo:400:kworker.0 00000100:00100000:0.0:1789673062.085801:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673062.085828:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738510080 00000100:00100000:0.0:1789673062.085835:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738510080 00000100:00100000:0.0:1789673062.085890:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789673062.085899:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738510080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673062.085948:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738510080:12345-0@lo:400:kworker.0 Request processed in 50us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673062.085955:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789673062.085989:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462dc000 x1876607738510080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789673078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789673062.086013:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738510080:0@lo:400:kworker.0 00000100:00100000:1.0:1789673062.086255:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738509952 00000100:00100000:1.0:1789673062.086260:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738509952 00000100:00100000:1.0:1789673062.086302:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738510592 00000100:00100000:1.0:1789673062.086305:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738510592 00000100:00100000:1.0:1789673062.086324:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789673062.086332:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738509952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673062.086383:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738509952:12345-0@lo:400:kworker.0 Request processed in 53us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673062.086390:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789673062.086403:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789673062.086409:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738510592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673062.086436:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738510592:12345-0@lo:400:kworker.0 Request processed in 27us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673062.086442:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789673062.086463:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789673062.086467:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789673062.086486:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462df480 x1876607738509952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673062.086495:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738509952:0@lo:400:kworker.0 00010000:00080000:1.0:1789673062.086504:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7d938000 x1876607738510592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673062.086511:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738510592:0@lo:400:kworker.0 00000100:00100000:3.0:1789673062.087560:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738510336:0@lo:400:kworker.0 00000100:00100000:3.0:1789673062.087618:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673062.087652:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789673062.087678:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738509568:0@lo:400:kworker.0 00000100:00100000:3.0:1789673062.087709:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673062.087739:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738510464:0@lo:400:kworker.0 00000100:00100000:3.0:1789673062.087760:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673062.087836:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738509568 00000100:00100000:3.0:1789673062.087844:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738509568 00000100:00100000:3.0:1789673062.087885:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789673062.087892:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:3637:x1876607738509568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673062.087935:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:3637:x1876607738509568:12345-0@lo:400:kworker.0 Request processed in 44us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673062.087942:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789673062.087974:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738510336 00000100:00100000:3.0:1789673062.087978:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738510336 00000100:00100000:3.0:1789673062.087993:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738510464 00000100:00100000:3.0:1789673062.087995:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738510464 00000100:00100000:3.0:1789673062.088018:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789673062.088023:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738510336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673062.088051:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738510336:12345-0@lo:400:kworker.0 Request processed in 28us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673062.088057:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789673062.088067:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789673062.088072:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738510464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673062.088093:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738510464:12345-0@lo:400:kworker.0 Request processed in 22us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673062.088110:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789673062.088125:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789673062.088137:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738509696:0@lo:8:kworker.0 00000100:00100000:3.0:1789673062.088166:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673062.088199:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738509824:0@lo:8:kworker.0 00000100:00100000:3.0:1789673062.088219:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673062.088231:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738510208:0@lo:8:kworker.0 00000100:00100000:3.0:1789673062.088254:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673062.088282:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738509696 00000100:00100000:3.0:1789673062.088286:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738509696 00000100:00100000:3.0:1789673062.088297:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738509824 00000100:00100000:3.0:1789673062.088299:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738509824 00000100:00100000:3.0:1789673062.088304:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738510208 00000100:00100000:3.0:1789673062.088306:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738510208 00000100:00100000:3.0:1789673062.088315:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789673062.088319:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1876607738509696:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789673062.088345:0:18647:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:3.0:1789673062.088376:0:18647:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c78c4f8c99663f8 00002000:00100000:3.0:1789673062.088389:0:18647:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cfb47a39800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789673062.088393:0:18647:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789673062.088396:0:18647:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789673062.088473:0:18647:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789673062.088498:0:18647:0:(import.c:65:import_set_state_nolock()) ffff8cfb47a3c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789673062.088538:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1876607738509696:12345-0@lo:8:kworker.0 Request processed in 218us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673062.088545:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789673062.088565:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789673062.088569:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1876607738509824:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789673062.088580:0:18647:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789673062.088607:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1876607738509824:12345-0@lo:8:kworker.0 Request processed in 37us (387us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789673062.088613:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789673062.088624:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789673062.088629:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1876607738510208:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789673062.088637:0:18647:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789673062.088681:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1876607738510208:12345-0@lo:8:kworker.0 Request processed in 51us (426us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789673062.088687:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789673062.088721:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738509568:0@lo:400:kworker.0 00010000:00080000:3.0:1789673062.088734:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7d938380 x1876607738510464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673062.088744:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738510464:0@lo:400:kworker.0 00010000:00080000:3.0:1789673062.088754:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7d93a300 x1876607738510336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673062.088761:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738510336:0@lo:400:kworker.0 00010000:00080000:3.0:1789673062.088789:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc462ddf80 x1876607738509696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789673087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673062.088796:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789673062.088802:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789673062.088809:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789673062.088820:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789673062.088823:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb4693c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789673062.088835:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789673062.088839:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738509696:0@lo:8:kworker.0 00000100:00080000:3.0:1789673062.088850:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789673062.088854:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789673062.088857:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738509824:0@lo:8:kworker.0 00000100:00080000:3.0:1789673062.088863:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc6173d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789673062.088866:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789673062.088868:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738510208:0@lo:8:kworker.0 00000004:00080000:3.0:1789673062.088918:0:17163:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789673062.088933:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17163:1876607738510848:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789673062.088955:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673062.088969:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bc5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789673062.088978:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738510848 00000100:00100000:3.0:1789673062.088981:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738510848 00000100:00100000:3.0:1789673062.089002:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789673062.089007:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17163:x1876607738510848:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1789673062.089236:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789673062.089499:0:17162:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789673062.089580:0:17162:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 540004921056ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789673062.089587:0:17162:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789673062.090073:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789673062.090091:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738510720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789673062.090138:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673062.092141:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738510720 00000100:00100000:2.0:1789673062.092152:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738510720 00000100:00100000:2.0:1789673062.092234:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789673062.092246:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1876607738510720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789673062.092280:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789673062.092362:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1876607738510720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (2222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673062.092369:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789673062.092430:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7c405f80 x1876607738510720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789673078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673062.092469:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738510720:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1789673062.097974:0:18647:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789673062.097996:0:18647:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789673062.098006:0:18647:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:3.0:1789673062.103738:0:17118:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789673062.115798:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.115813:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c99663ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.115832:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.115837:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.115859:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c99663ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.115880:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c99663ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.115890:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c99663ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.115897:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c99663ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.115919:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789673062.116078:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673062.116086:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c99663ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.116094:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4400 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673062.116098:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c99663ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.116115:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c99663ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.116133:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c99663ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.116141:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c99663ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.116160:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.116162:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.116164:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673062.116899:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.116906:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966406 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.116915:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.116919:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.116923:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.116932:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.116941:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.116961:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.116985:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789673062.117263:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789673062.117270:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.117278:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4800 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789673062.117281:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.117288:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966406 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.117302:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966406 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.117308:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966406 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.117325:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.117327:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.117329:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789673062.121249:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789673062.121267:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ed523c5/0x6c78c4f8c996640d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.121304:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=540s v=(0 0) 00010000:00010000:0.0:1789673062.121310:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789673062.121317:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ed523c5/0x6c78c4f8c996640d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.121332:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ed523c5/0x6c78c4f8c996640d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.121344:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ed523c5/0x6c78c4f8c996640d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.121353:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ed523c5/0x6c78c4f8c996640d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.121378:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789673062.121750:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673062.121759:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ed523c5/0x6c78c4f8c996640d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.121769:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc400 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673062.121773:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ed523c5/0x6c78c4f8c996640d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.121784:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ed523c5/0x6c78c4f8c996640d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.121801:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ed523c5/0x6c78c4f8c996640d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.121819:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ed523c5/0x6c78c4f8c996640d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.121842:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.121844:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.121845:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673062.124822:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.124834:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c9966414 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.124847:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.124851:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.124856:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c9966414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.124868:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c9966414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.124876:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c9966414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.124882:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c9966414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.124901:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789673062.125114:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789673062.125121:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c9966414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.125129:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4e00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789673062.125133:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c9966414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.125143:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c9966414 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.125194:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c9966414 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.125202:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c9966414 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.125228:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.125230:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.125232:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673062.125937:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.125946:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c996641b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.125966:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.125969:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.125974:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c996641b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.125984:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c996641b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.125992:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c996641b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.126368:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c996641b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.126428:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789673062.127337:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.127345:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0113bb7/0x6c78c4f8c9966422 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.127357:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.127360:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.127365:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0113bb7/0x6c78c4f8c9966422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.127376:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0113bb7/0x6c78c4f8c9966422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.127401:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0113bb7/0x6c78c4f8c9966422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.127494:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0113bb7/0x6c78c4f8c9966422 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.127550:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789673062.127558:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c996641b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.127567:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4000 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673062.127571:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c996641b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.127580:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c996641b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.127597:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c996641b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.127604:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089574159/0x6c78c4f8c996641b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.127622:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673062.127625:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0113bb7/0x6c78c4f8c9966422 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.127640:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5a00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673062.127643:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0113bb7/0x6c78c4f8c9966422 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.127652:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0113bb7/0x6c78c4f8c9966422 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.127687:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0113bb7/0x6c78c4f8c9966422 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.127695:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.127696:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.127698:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673062.127830:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789673062.127835:0:18647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0113bb7/0x6c78c4f8c9966422 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789673062.128356:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.128365:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966429 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.128374:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.128378:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.128382:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.128393:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.128402:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.128423:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966429 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.128536:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789673062.128543:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966429 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.128551:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4c00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789673062.128555:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966429 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.128564:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966429 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.128577:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966429 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.128586:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.128588:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.128589:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673062.128646:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789673062.128652:0:18647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000076d111a/0x6c78c4f8c9966429 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789673062.129060:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.129067:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061267ede/0x6c78c4f8c9966430 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.129077:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.129079:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.129083:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061267ede/0x6c78c4f8c9966430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.129092:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061267ede/0x6c78c4f8c9966430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.129100:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061267ede/0x6c78c4f8c9966430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.129107:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061267ede/0x6c78c4f8c9966430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.129140:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789673062.129430:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789673062.129436:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061267ede/0x6c78c4f8c9966430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.129444:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5200 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789673062.129447:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061267ede/0x6c78c4f8c9966430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.129455:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061267ede/0x6c78c4f8c9966430 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.129464:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061267ede/0x6c78c4f8c9966430 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.129469:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061267ede/0x6c78c4f8c9966430 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.129480:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.129481:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.129482:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673062.129540:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.129545:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046898ca0/0x6c78c4f8c9966437 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.129553:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.129556:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.129560:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046898ca0/0x6c78c4f8c9966437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.129569:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046898ca0/0x6c78c4f8c9966437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.129577:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046898ca0/0x6c78c4f8c9966437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.129585:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046898ca0/0x6c78c4f8c9966437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.129605:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789673062.129746:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789673062.129750:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046898ca0/0x6c78c4f8c9966437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.129755:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5800 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789673062.129757:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046898ca0/0x6c78c4f8c9966437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.129770:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046898ca0/0x6c78c4f8c9966437 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.129778:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046898ca0/0x6c78c4f8c9966437 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.129782:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046898ca0/0x6c78c4f8c9966437 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.129790:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.129791:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.129792:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.129892:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673062.130143:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.130149:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a25346b/0x6c78c4f8c996643e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.130157:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.130166:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.130171:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a25346b/0x6c78c4f8c996643e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.130195:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a25346b/0x6c78c4f8c996643e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.130207:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a25346b/0x6c78c4f8c996643e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.130215:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a25346b/0x6c78c4f8c996643e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.130267:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789673062.130737:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.130743:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c9966445 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.130752:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.130755:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.130759:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c9966445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.130769:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c9966445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.130778:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c9966445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.130792:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c9966445 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.130840:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789673062.130846:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a25346b/0x6c78c4f8c996643e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.130853:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5400 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789673062.130857:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a25346b/0x6c78c4f8c996643e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.130865:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a25346b/0x6c78c4f8c996643e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.130878:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a25346b/0x6c78c4f8c996643e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.130896:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a25346b/0x6c78c4f8c996643e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.130913:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789673062.130917:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c9966445 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.130922:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4400 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789673062.130926:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c9966445 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.130933:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c9966445 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.130943:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c9966445 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.130949:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.130951:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.130953:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673062.131079:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789673062.131086:0:18647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fbae90e/0x6c78c4f8c9966445 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789673062.131570:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.131577:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c996644c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.131586:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.131590:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.131594:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c996644c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.131603:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c996644c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.131611:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c996644c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.131618:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c996644c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.131701:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673062.131709:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c996644c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.131716:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4e00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673062.131720:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c996644c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.131729:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c996644c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.131741:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c996644c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.131755:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.131757:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.131759:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673062.131872:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789673062.131878:0:18647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a611e91b/0x6c78c4f8c996644c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789673062.132228:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.132234:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966453 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.132244:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.132247:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.132251:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.132261:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.132270:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.132277:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966453 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.133271:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789673062.133281:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966453 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.133291:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4800 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789673062.133323:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966453 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.133333:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966453 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.133351:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966453 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.133363:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.133365:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.133367:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673062.133677:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789673062.133684:0:18647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c9966453 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.133709:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673062.134888:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.134900:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000972fd02c/0x6c78c4f8c996645a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.134913:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.134918:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.134924:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000972fd02c/0x6c78c4f8c996645a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.134938:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000972fd02c/0x6c78c4f8c996645a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.134949:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000972fd02c/0x6c78c4f8c996645a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.134958:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000972fd02c/0x6c78c4f8c996645a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.134985:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789673062.135363:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673062.135370:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000972fd02c/0x6c78c4f8c996645a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.135379:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5000 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673062.135383:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000972fd02c/0x6c78c4f8c996645a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.135392:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000972fd02c/0x6c78c4f8c996645a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.135407:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000972fd02c/0x6c78c4f8c996645a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.135415:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000972fd02c/0x6c78c4f8c996645a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789673062.135419:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.135424:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c9966461 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.135432:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=540s v=(0 0) 00010000:00010000:1.0:1789673062.135434:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673062.135435:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673062.135435:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.135437:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673062.135448:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c9966461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.135459:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c9966461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.135467:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c9966461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.135474:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c9966461 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.135495:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789673062.135594:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673062.135600:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c9966461 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.135615:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4200 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673062.135618:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c9966461 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.135626:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c9966461 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.135637:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c9966461 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.135643:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c9966461 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.135689:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.135691:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.135693:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673062.135908:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.135914:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065322092/0x6c78c4f8c9966468 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.135923:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.135927:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.135931:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065322092/0x6c78c4f8c9966468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.135940:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065322092/0x6c78c4f8c9966468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.135948:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065322092/0x6c78c4f8c9966468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.135967:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065322092/0x6c78c4f8c9966468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.136021:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789673062.140102:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.140119:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c996646f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.140138:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.140143:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.140148:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c996646f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.140163:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c996646f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.140174:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c996646f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.140194:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c996646f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.140528:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789673062.140539:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065322092/0x6c78c4f8c9966468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.140547:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886a00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673062.140551:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065322092/0x6c78c4f8c9966468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.140561:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065322092/0x6c78c4f8c9966468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.140597:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065322092/0x6c78c4f8c9966468 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.140605:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065322092/0x6c78c4f8c9966468 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.140625:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673062.140629:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c996646f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.140635:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886600 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673062.140639:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c996646f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.140646:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c996646f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.140655:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c996646f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.140688:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.140690:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.140692:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673062.140825:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789673062.140830:0:18647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c996646f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789673062.141487:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.141495:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c9966476 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.141507:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.141511:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.141516:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c9966476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.141528:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c9966476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.141537:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c9966476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.141545:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c9966476 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.141583:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673062.141589:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c9966476 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.141610:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886400 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673062.141613:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c9966476 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.141622:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c9966476 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.141634:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c9966476 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.141643:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.141645:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.141646:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673062.141855:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789673062.141860:0:18647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c9966476 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.142055:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673062.142346:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.142354:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f4cfe0d/0x6c78c4f8c996647d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.142375:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.142379:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.142384:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f4cfe0d/0x6c78c4f8c996647d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.142394:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f4cfe0d/0x6c78c4f8c996647d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.142403:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f4cfe0d/0x6c78c4f8c996647d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.142411:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f4cfe0d/0x6c78c4f8c996647d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.142432:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789673062.142799:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.142805:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c9966484 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.142814:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.142818:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.142822:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c9966484 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.142831:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c9966484 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.142851:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c9966484 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.142859:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c9966484 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.142883:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789673062.143059:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789673062.143066:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f4cfe0d/0x6c78c4f8c996647d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.143076:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887c00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789673062.143080:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f4cfe0d/0x6c78c4f8c996647d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.143090:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f4cfe0d/0x6c78c4f8c996647d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.143106:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f4cfe0d/0x6c78c4f8c996647d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.143125:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f4cfe0d/0x6c78c4f8c996647d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.143148:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789673062.143151:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c9966484 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.143159:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887000 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789673062.143162:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c9966484 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.143171:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c9966484 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.143207:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c9966484 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.143215:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c9966484 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.143227:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.143229:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.143231:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673062.143450:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789673062.143624:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673062.143759:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd3d6e87/0x6c78c4f8c996648b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.143771:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.143774:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.143779:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd3d6e87/0x6c78c4f8c996648b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.143789:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd3d6e87/0x6c78c4f8c996648b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.143799:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd3d6e87/0x6c78c4f8c996648b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.143807:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd3d6e87/0x6c78c4f8c996648b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.143842:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789673062.143862:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673062.143868:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd3d6e87/0x6c78c4f8c996648b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.143875:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887400 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673062.143878:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd3d6e87/0x6c78c4f8c996648b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.143886:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd3d6e87/0x6c78c4f8c996648b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.143908:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd3d6e87/0x6c78c4f8c996648b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.143915:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd3d6e87/0x6c78c4f8c996648b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.143928:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.143930:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.143932:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673062.144272:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.144278:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef2a2afe/0x6c78c4f8c9966492 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.144287:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.144290:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.144294:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef2a2afe/0x6c78c4f8c9966492 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.144303:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef2a2afe/0x6c78c4f8c9966492 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.144310:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef2a2afe/0x6c78c4f8c9966492 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.144376:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef2a2afe/0x6c78c4f8c9966492 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.144398:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789673062.144627:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673062.144633:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef2a2afe/0x6c78c4f8c9966492 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.144641:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887800 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673062.144645:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef2a2afe/0x6c78c4f8c9966492 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.144653:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef2a2afe/0x6c78c4f8c9966492 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789673062.145056:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.145063:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c9966499 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.145073:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.145083:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.145088:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c9966499 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.145098:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c9966499 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.145107:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c9966499 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.145115:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c9966499 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.145236:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef2a2afe/0x6c78c4f8c9966492 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.145243:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef2a2afe/0x6c78c4f8c9966492 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.145270:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673062.145274:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c9966499 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.145282:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886600 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673062.145286:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c9966499 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.145294:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c9966499 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.145305:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c9966499 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.145312:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.145314:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673062.145415:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789673062.145420:0:18647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7d30538/0x6c78c4f8c9966499 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789673062.145813:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.145820:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf5cefd0/0x6c78c4f8c99664a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.145829:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.145833:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.145837:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf5cefd0/0x6c78c4f8c99664a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.145846:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf5cefd0/0x6c78c4f8c99664a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.145861:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf5cefd0/0x6c78c4f8c99664a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.145869:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf5cefd0/0x6c78c4f8c99664a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.146012:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789673062.146019:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf5cefd0/0x6c78c4f8c99664a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.146027:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887e00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789673062.146038:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf5cefd0/0x6c78c4f8c99664a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.146047:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf5cefd0/0x6c78c4f8c99664a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.146060:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf5cefd0/0x6c78c4f8c99664a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.146069:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.146070:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.146072:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.146163:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673062.146231:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789673062.146236:0:18647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf5cefd0/0x6c78c4f8c99664a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789673062.146615:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.146623:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c937a595/0x6c78c4f8c99664a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.146633:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.146636:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.146640:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c937a595/0x6c78c4f8c99664a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.146651:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c937a595/0x6c78c4f8c99664a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.146689:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c937a595/0x6c78c4f8c99664a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.146708:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c937a595/0x6c78c4f8c99664a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.146754:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789673062.146759:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c937a595/0x6c78c4f8c99664a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.146766:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887a00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789673062.146768:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c937a595/0x6c78c4f8c99664a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.146776:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c937a595/0x6c78c4f8c99664a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.146787:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c937a595/0x6c78c4f8c99664a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.146794:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.146802:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.146803:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673062.146896:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789673062.146900:0:18647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c937a595/0x6c78c4f8c99664a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789673062.147279:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.147285:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088cf57cc/0x6c78c4f8c99664ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.147294:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.147297:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.147301:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088cf57cc/0x6c78c4f8c99664ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.147310:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088cf57cc/0x6c78c4f8c99664ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.147372:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088cf57cc/0x6c78c4f8c99664ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.147379:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088cf57cc/0x6c78c4f8c99664ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.147421:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673062.147428:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088cf57cc/0x6c78c4f8c99664ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.147435:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886e00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673062.147439:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088cf57cc/0x6c78c4f8c99664ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.147459:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088cf57cc/0x6c78c4f8c99664ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.147471:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088cf57cc/0x6c78c4f8c99664ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673062.147479:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.147480:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673062.147482:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673062.147963:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789673062.147970:0:18647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088cf57cc/0x6c78c4f8c99664ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789673062.148883:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673062.148892:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c99664b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.148904:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1789673062.148909:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673062.148914:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c99664b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.148926:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c99664b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.148936:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c99664b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673062.148944:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c99664b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.150207:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789673062.150220:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c99664b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.150232:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886400 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:0.0:1789673062.150237:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c99664b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.150249:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c99664b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.150267:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c99664b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673062.150276:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.150278:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673062.150280:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673062.150435:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789673062.150441:0:18647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086e5013b/0x6c78c4f8c99664b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789673062.150566:0:18647:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1789673062.150740:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17163:x1876607738510848:12345-0@lo:5:osp-pre-0-0.0 Request processed in 61727us (61778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673062.150751:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789673062.150840:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673062.150896:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17163:1876607738510848:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789673062.150913:0:17163:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1789673062.150961:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17163:1876607738510976:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789673062.161266:0:17163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673062.161342:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc67ebc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789673062.161928:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738510976 00000100:00100000:1.0:1789673062.161939:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738510976 00000100:00100000:1.0:1789673062.162006:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789673062.162016:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17163:x1876607738510976:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789673062.162066:0:18648:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1789673062.185902:0:18642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1789673062.185952:0:18642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789673062.186283:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17163:x1876607738510976:12345-0@lo:5:osp-pre-0-0.0 Request processed in 24262us (25015us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789673062.186295:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789673062.188498:0:17163:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1789673062.188515:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17163:1876607738510976:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789673062.188558:0:17163:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:0.0:1789673062.468900:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673063.495338:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673064.517322:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789673065.286235:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789673065.286268:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738511104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789673065.286337:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673065.286389:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738511104 00000100:00100000:3.0:1789673065.286400:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738511104 00000100:00080000:0.0:1789673065.286463:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789673065.286481:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789673065.286492:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738511104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789673065.286524:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789673065.286585:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f716a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738511104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673065.286593:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789673065.286893:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738511104:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789673065.541988:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789673066.307893:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738511232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789673066.307964:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673066.308056:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738511232 00000100:00100000:2.0:1789673066.308064:0:17882:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738511232 00000100:00100000:2.0:1789673066.308125:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789673066.308135:0:17882:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738511232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789673066.308169:0:17882:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789673066.308215:0:17882:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738511232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673066.308222:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789673066.308283:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738511232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789673066.308372:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789673066.308380:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738511360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789673066.308402:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673066.308427:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738511360 00000100:00100000:1.0:1789673066.308430:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738511360 00000100:00100000:1.0:1789673066.308448:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789673066.308453:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738511360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789673066.308474:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789673066.308508:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738511360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673066.308522:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789673066.308545:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738511360:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789673066.566514:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789673067.269593:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1789673067.332723:0:18407:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789673067.332732:0:18407:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789673067.332736:0:18407:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789673067.332744:0:18407:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 539 00000100:00080000:2.0:1789673067.332750:0:18407:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789673067.332762:0:18407:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfc458c7800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789673067.332793:0:18407:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7f717800 x1876607738511872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789673067.332931:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3636:1876607738511488:0@lo:400:kworker.0 00000100:00100000:1.0:1789673067.333015:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673067.333251:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738512000:0@lo:400:kworker.0 00000100:00100000:0.0:1789673067.333399:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673067.333465:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738512000 00000100:00100000:1.0:1789673067.333473:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738512000 00000100:00100000:1.0:1789673067.333525:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789673067.333533:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738512000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673067.335473:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738512000:12345-0@lo:400:kworker.0 Request processed in 1935us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673067.335487:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789673067.335642:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7f715f80 x1876607738512000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789673067.335676:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738512000:0@lo:400:kworker.0 00000100:00100000:0.0:1789673067.335696:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789673067.335705:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738512128:0@lo:400:kworker.0 00000100:00100000:0.0:1789673067.335756:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673067.335914:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738512128 00000100:00100000:1.0:1789673067.335921:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738512128 00000100:00100000:1.0:1789673067.335973:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789673067.335982:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738512128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673067.336033:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738512128:12345-0@lo:400:kworker.0 Request processed in 52us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673067.336040:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789673067.336067:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738512128:0@lo:400:kworker.0 00000100:00080000:2.0:1789673067.336156:0:18407:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789673067.336161:0:18407:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789673067.336165:0:18407:0:(import.c:65:import_set_state_nolock()) ffff8cfc6173d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789673067.336171:0:18407:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 539 00000100:00080000:2.0:1789673067.336175:0:18407:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789673067.336183:0:18407:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cfc6173d000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789673067.336202:0:18407:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc41219c00 x1876607738512384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789673067.336274:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738511616:0@lo:400:kworker.0 00000100:00100000:1.0:1789673067.336589:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738512640:0@lo:400:kworker.0 00000100:00100000:1.0:1789673067.336626:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673067.336649:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789673067.336656:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738512768:0@lo:400:kworker.0 00000100:00100000:1.0:1789673067.336699:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673067.336745:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738512640 00000100:00100000:1.0:1789673067.336750:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738512640 00000100:00100000:1.0:1789673067.336787:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738512768 00000100:00100000:1.0:1789673067.336790:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738512768 00000100:00100000:1.0:1789673067.336806:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789673067.336813:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738512640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673067.337392:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738512640:12345-0@lo:400:kworker.0 Request processed in 577us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673067.337401:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789673067.337420:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789673067.337427:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738512768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673067.337454:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738512768:12345-0@lo:400:kworker.0 Request processed in 28us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673067.337460:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789673067.337476:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789673067.337480:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789673067.337508:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc4121a680 x1876607738512768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673067.337522:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738512768:0@lo:400:kworker.0 00010000:00080000:1.0:1789673067.337533:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc41219880 x1876607738512640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673067.337543:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738512640:0@lo:400:kworker.0 00000100:00100000:2.0:1789673067.337649:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673067.337699:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738512256:0@lo:400:kworker.0 00000100:00100000:2.0:1789673067.337725:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673067.337745:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738512896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789673067.337770:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673067.337792:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789673067.337798:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738511744:0@lo:400:kworker.0 00000100:00100000:2.0:1789673067.337816:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673067.337844:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738512512:0@lo:400:kworker.0 00000100:00100000:2.0:1789673067.337865:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673067.337896:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738511872:0@lo:8:kworker.0 00000100:00100000:2.0:1789673067.337924:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673067.337941:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738512384:0@lo:8:kworker.0 00000100:00100000:2.0:1789673067.337971:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673067.338003:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738511488 00000100:00100000:2.0:1789673067.338008:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738511488 00000100:00100000:2.0:1789673067.338044:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789673067.338051:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:3636:x1876607738511488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789673067.338094:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:3636:x1876607738511488:12345-0@lo:400:kworker.0 Request processed in 33us (5068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673067.338101:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789673067.338134:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738512256 00000100:00100000:2.0:1789673067.338138:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738512256 00000100:00100000:2.0:1789673067.338167:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738511744 00000100:00100000:2.0:1789673067.338170:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738511744 00000100:00100000:2.0:1789673067.338181:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738511872 00000100:00100000:2.0:1789673067.338184:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738511872 00000100:00100000:2.0:1789673067.338192:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738512384 00000100:00100000:2.0:1789673067.338195:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738512384 00000100:00100000:2.0:1789673067.338204:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789673067.338210:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738512256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789673067.338248:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738512256:12345-0@lo:400:kworker.0 Request processed in 39us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673067.338254:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789673067.338265:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789673067.338270:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738511744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789673067.338329:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738511744:12345-0@lo:400:kworker.0 Request processed in 57us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673067.338335:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789673067.338348:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789673067.338352:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876607738511872:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789673067.338381:0:18646:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789673067.338414:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876607738511872:12345-0@lo:8:kworker.0 Request processed in 60us (488us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789673067.338421:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789673067.338446:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789673067.338451:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876607738512384:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789673067.338460:0:18646:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789673067.338480:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3636:1876607738511488:0@lo:400:kworker.0 00000100:00100000:2.0:1789673067.338485:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1876607738512384:12345-0@lo:8:kworker.0 Request processed in 34us (514us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789673067.338490:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789673067.338508:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738512896 00000100:00100000:2.0:1789673067.338512:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738512896 00000100:00100000:2.0:1789673067.338548:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789673067.338555:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738512896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789673067.338578:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789673067.338612:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738512896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673067.338618:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789673067.338647:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789673067.338713:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789673067.338718:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789673067.338721:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738511872:0@lo:8:kworker.0 00000100:00080000:2.0:1789673067.338732:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc6173d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789673067.338735:0:3634:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789673067.338738:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738512384:0@lo:8:kworker.0 00000100:00100000:2.0:1789673067.338771:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738512512 00000100:00100000:2.0:1789673067.338776:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738512512 00000100:00100000:2.0:1789673067.338813:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789673067.338820:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738512512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789673067.338854:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738512512:12345-0@lo:400:kworker.0 Request processed in 35us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673067.338861:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789673067.338887:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738511744:0@lo:400:kworker.0 00010000:00080000:2.0:1789673067.338901:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc4121bb80 x1876607738512512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673067.338911:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738512512:0@lo:400:kworker.0 00000100:00100000:2.0:1789673067.338922:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738512256:0@lo:400:kworker.0 00000100:00100000:2.0:1789673067.338935:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738512896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789673067.340494:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738511616 00000100:00100000:1.0:1789673067.340506:0:17882:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738511616 00000100:00100000:1.0:1789673067.340553:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789673067.340562:0:17882:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738511616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673067.340680:0:17882:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738511616:12345-0@lo:400:kworker.0 Request processed in 119us (3030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673067.340688:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789673067.340715:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738511616:0@lo:400:kworker.0 00010000:00010000:1.0:1789673067.589980:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789673067.707302:0:19461:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789673067.707306:0:19461:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789673067.707308:0:19461:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789673067.707425:0:19461:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cfb467e4000 00000020:01000004:2.0:1789673067.707443:0:19461:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789673067.708429:0:19461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789673067.709014:0:19461:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cfc74590000) 00000020:00000080:2.0:1789673067.710171:0:19461:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789673067.790762:0:19461:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789673067.795995:0:19461:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789673067.796397:0:19461:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789673067.798412:0:19461:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789673067.799867:0:19461:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789673067.800279:0:19461:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789673067.800593:0:19461:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1789673067.802948:0:19461:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789673067.803189:0:19461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789673067.803205:0:19461:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789673067.803302:0:19461:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6c78c4f8c99664c3 00000020:01000004:0.0:1789673067.803311:0:19461:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789673067.803333:0:19461:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.150@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789673067.803336:0:19461:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789673067.803345:0:19461:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789673067.803374:0:19461:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1789673067.803377:0:19461:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789673067.827415:0:19461:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.150@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789673067.827486:0:19461:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.150@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789673067.827492:0:19461:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789673067.827493:0:19461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789673067.827495:0:19461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789673067.827496:0:19461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789673067.827497:0:19461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789673067.827498:0:19461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789673067.827500:0:19461:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789673067.827502:0:19461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789673067.827503:0:19461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789673067.827507:0:19461:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789673067.827510:0:19461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789673067.827511:0:19461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789673067.827513:0:19461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789673067.827514:0:19461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789673067.827515:0:19461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789673067.827516:0:19461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789673067.827518:0:19461:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789673067.827519:0:19461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789673067.827520:0:19461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789673067.827551:0:19461:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789673067.827573:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738513024:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789673067.827646:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673067.827729:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7442d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789673067.827853:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738513024 00000100:00100000:3.0:1789673067.827860:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738513024 00000100:00100000:3.0:1789673067.827908:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789673067.827917:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:19461:x1876607738513024:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789673067.827950:0:17132:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789673067.827954:0:17132:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789673067.827963:0:17132:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789673067.828423:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:19461:x1876607738513024:12345-0@lo:253:mount.lustre.0 Request processed in 508us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673067.828430:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789673067.828737:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738513024:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789673067.828748:0:19461:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789673067.828751:0:19461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789673067.828754:0:19461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789673067.828765:0:19461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789673067.828766:0:19461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789673067.828767:0:19461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789673067.828768:0:19461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789673067.828769:0:19461:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789673067.828770:0:19461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789673067.828771:0:19461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789673067.828791:0:19461:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cfb467e4000 from lustre-OST0001 10000000:01000000:1.0:1789673067.828819:0:19461:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789673067.828821:0:19461:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789673067.828829:0:19461:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cfb477b0000 local copy 00010000:00010000:1.0:1789673067.828838:0:19461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cc600/0x6c78c4f8c9966119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966120 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673067.828910:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738513152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789673067.828935:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673067.828964:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7442dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789673067.828981:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738513152 00000100:00100000:2.0:1789673067.828988:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738513152 00000100:00100000:2.0:1789673067.829169:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789673067.829181:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:19461:x1876607738513152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789673067.829275:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:19461:x1876607738513152:12345-0@lo:501:mount.lustre.0 Request processed in 96us (337us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789673067.829330:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738513152:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789673067.829343:0:19461:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789673067.829360:0:19461:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789673067.829366:0:19461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cc600/0x6c78c4f8c9966119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966120 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673067.829380:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00010000:1.0:1789673067.830180:0:19461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cc600/0x6c78c4f8c9966119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966120 expref: -99 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789673067.830209:0:19461:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cfb467e4000 10000000:01000000:1.0:1789673067.830214:0:19461:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789673067.830220:0:19461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789673067.830223:0:19461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789673067.830227:0:19461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789673067.830238:0:19461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789673067.830267:0:19461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52434c00/0x6c78c4f8c99664ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673067.830276:0:19461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc52434c00/0x6c78c4f8c99664ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673067.830285:0:19461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc52434c00/0x6c78c4f8c99664ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673067.830300:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738513280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789673067.830331:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673067.830409:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7442dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789673067.831629:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738513280 00000100:00100000:3.0:1789673067.831641:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738513280 00000100:00100000:3.0:1789673067.835937:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789673067.835956:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:19461:x1876607738513280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789673067.835975:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673067.836005:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d887a00/0x6c78c4f8c99664d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99664ca expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.836039:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d887a00/0x6c78c4f8c99664d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99664ca expref: 22 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.836050:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d887a00/0x6c78c4f8c99664d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99664ca expref: 22 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.836060:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887a00, rc 0) 00000100:00100000:3.0:1789673067.836349:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:19461:x1876607738513280:12345-0@lo:101:mount.lustre.0 Request processed in 398us (6014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673067.836357:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789673067.839424:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738513280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789673067.839472:0:19461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc52434c00/0x6c78c4f8c99664ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99664d1 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673067.839486:0:19461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc52434c00/0x6c78c4f8c99664ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99664d1 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789673067.840807:0:19461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789673067.841604:0:19461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789673067.843778:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789673067.843847:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789673067.843864:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789673067.843877:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789673067.843890:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789673067.843905:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789673067.843934:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789673067.843941:0:19461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789673067.844067:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738513408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789673067.844155:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673067.844197:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7442dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789673067.844362:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738513408 00000100:00100000:3.0:1789673067.844371:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738513408 00000100:00100000:3.0:1789673067.844433:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789673067.844560:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:19461:x1876607738513408:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789673067.844764:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:19461:x1876607738513408:12345-0@lo:501:mount.lustre.0 Request processed in 321us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673067.844773:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789673067.846034:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738513408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789673067.846108:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738513536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789673067.846172:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673067.846203:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7442dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789673067.847135:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738513536 00000100:00100000:0.0:1789673067.847146:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738513536 00000100:00100000:0.0:1789673067.847215:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789673067.847225:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:19461:x1876607738513536:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789673067.848053:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:19461:x1876607738513536:12345-0@lo:503:mount.lustre.0 Request processed in 827us (1877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673067.848063:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789673067.848492:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738513536:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789673067.849112:0:19461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789673067.849226:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c404a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738513664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789673067.849285:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673067.849334:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc8158bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789673067.849493:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738513664 00000100:00100000:2.0:1789673067.849501:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738513664 00000100:00100000:2.0:1789673067.849556:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789673067.849566:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:19461:x1876607738513664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673067.853151:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:19461:x1876607738513664:12345-0@lo:502:mount.lustre.0 Request processed in 3577us (3856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673067.853167:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789673067.856486:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c404a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738513664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789673067.856857:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789673067.856886:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789673067.856896:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789673067.856907:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789673067.856917:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789673067.856927:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789673067.856937:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789673067.856947:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789673067.856957:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1789673067.856991:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d938700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738513792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789673067.857593:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673067.857687:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4c274480 going to sleep for 11 seconds 00000100:00100000:3.0:1789673067.864105:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738513792 00000100:00100000:3.0:1789673067.864122:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738513792 00000100:00100000:3.0:1789673067.864191:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789673067.864202:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:19461:x1876607738513792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789673067.864400:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:19461:x1876607738513792:12345-0@lo:502:mount.lustre.0 Request processed in 200us (6808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673067.864409:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789673067.864458:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d938700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738513792:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789673067.864798:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789673067.864829:0:19461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1789673067.866329:0:19465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789673067.866340:0:19465:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789673067.866347:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789673067.866350:0:19465:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789673067.866356:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789673067.866375:0:19465:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cfc7c67cd40) 00000020:00000080:3.0:1789673067.866404:0:19465:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789673067.866410:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789673067.866520:0:19465:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfb467e4000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789673067.866529:0:19465:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789673067.866538:0:19465:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6c78c4f8c99664df 00010000:00010000:3.0:1789673067.871422:0:19465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1789673067.872095:0:19465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1789673067.874087:0:19465:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1789673067.879914:0:19465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789673067.879931:0:19465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789673067.879939:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673067.879954:0:19465:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789673067.879959:0:19465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789673067.879974:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673067.879976:0:19465:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789673067.879981:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789673067.879983:0:19465:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789673067.879986:0:19465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789673067.879989:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673067.879991:0:19465:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789673067.879993:0:19465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789673067.879996:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673067.879998:0:19465:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789673067.880002:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789673067.880054:0:19465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789673067.880057:0:19465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673067.880059:0:19465:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789673067.880062:0:19465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789673067.880508:0:19461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789673067.880545:0:19461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789673067.880573:0:19461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc52434c00/0x6c78c4f8c99664ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99664d1 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673067.880586:0:19461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc52434c00/0x6c78c4f8c99664ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99664d1 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789673067.880595:0:19461:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfb467e4000 from 1 10000000:01000000:2.0:1789673067.880598:0:19461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789673067.880637:0:19461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99664e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673067.880646:0:19461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99664e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673067.880678:0:19461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99664e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673067.880705:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738513920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789673067.880788:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673067.880831:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc47ca2240 going to sleep for 11 seconds 00000100:00100000:0.0:1789673067.881444:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738513920 00000100:00100000:0.0:1789673067.881453:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738513920 00000100:00100000:0.0:1789673067.881516:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789673067.881527:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:19461:x1876607738513920:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789673067.881542:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673067.881559:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8cd800/0x6c78c4f8c99664ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99664e6 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673067.881595:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8cd800/0x6c78c4f8c99664ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99664e6 expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673067.881606:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8cd800/0x6c78c4f8c99664ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99664e6 expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673067.881616:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cd800, rc 0) 00000100:00100000:0.0:1789673067.881696:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:19461:x1876607738513920:12345-0@lo:101:mount.lustre.0 Request processed in 170us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673067.881714:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789673067.881722:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738513920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789673067.881743:0:19461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99664e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99664ed expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.881753:0:19461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99664e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99664ed expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789673067.884746:0:19461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789673067.887534:0:19461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789673067.887871:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789673067.887904:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789673067.887927:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789673067.887933:0:19461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789673067.888048:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738514048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789673067.888131:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673067.888189:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc47ca2240 going to sleep for 11 seconds 00000100:00100000:1.0:1789673067.888304:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738514048 00000100:00100000:1.0:1789673067.888313:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738514048 00000100:00100000:1.0:1789673067.888371:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789673067.888381:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:19461:x1876607738514048:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789673067.888591:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:19461:x1876607738514048:12345-0@lo:501:mount.lustre.0 Request processed in 210us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673067.888600:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789673067.888706:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738514048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789673067.888747:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c406a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738514176:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789673067.888792:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673067.888816:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc8158ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789673067.888884:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738514176 00000100:00100000:1.0:1789673067.888889:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738514176 00000100:00100000:1.0:1789673067.888921:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789673067.888929:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:19461:x1876607738514176:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789673067.889144:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:19461:x1876607738514176:12345-0@lo:503:mount.lustre.0 Request processed in 215us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673067.889151:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789673067.891628:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c406a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738514176:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789673067.892937:0:19461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789673067.893223:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738514304:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789673067.893321:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673067.893442:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc431710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789673067.893494:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738514304 00000100:00100000:3.0:1789673067.893504:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738514304 00000100:00100000:3.0:1789673067.893777:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789673067.893789:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:19461:x1876607738514304:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789673067.893970:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:19461:x1876607738514304:12345-0@lo:502:mount.lustre.0 Request processed in 183us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673067.893979:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789673067.894296:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738514304:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789673067.906937:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789673067.907006:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789673067.908233:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789673067.908272:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789673067.908287:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789673067.908301:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789673067.908314:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789673067.908326:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1789673067.908339:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789673067.908351:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1789673067.908366:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1789673067.908447:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738514432:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789673067.908543:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673067.908779:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc431710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789673067.912330:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738514432 00000100:00100000:2.0:1789673067.912349:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738514432 00000100:00100000:2.0:1789673067.912494:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789673067.912507:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:19461:x1876607738514432:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673067.912757:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:19461:x1876607738514432:12345-0@lo:502:mount.lustre.0 Request processed in 252us (4213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673067.912766:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789673067.912909:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738514432:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789673067.913006:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1789673067.913030:0:19461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789673067.916456:0:19469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789673067.916473:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673067.916476:0:19469:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789673067.916485:0:19469:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfb467e4000 00000020:00000080:0.0:1789673067.916488:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789673067.916505:0:19469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789673067.916507:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673067.916509:0:19469:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789673067.916512:0:19469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789673067.916514:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673067.916516:0:19469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789673067.916519:0:19469:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cfb467e4000 00000020:00000080:0.0:1789673067.916521:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789673067.916596:0:19469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789673067.916600:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673067.916602:0:19469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789673067.916605:0:19469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789673067.916608:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673067.916609:0:19469:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789673067.916613:0:19469:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfb467e4000 00000020:00000080:0.0:1789673067.916615:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789673067.916645:0:19469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789673067.916649:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673067.916651:0:19469:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789673067.916653:0:19469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789673067.916677:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673067.916679:0:19469:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789673067.916684:0:19469:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cfb467e4000 00000020:00000080:0.0:1789673067.916687:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789673067.916712:0:19469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789673067.916715:0:19469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789673067.916716:0:19469:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789673067.916719:0:19469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789673067.917708:0:19461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789673067.917743:0:19461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789673067.917803:0:19461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99664e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99664ed expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673067.917816:0:19461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99664e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99664ed expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789673067.917891:0:19461:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789673067.917895:0:19461:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cfb467e4000 10000000:01000000:2.0:1789673067.917899:0:19461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cfb467e4000 10000000:01000000:2.0:1789673067.917910:0:19461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789673067.917924:0:19461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cfb467e4000 from 1 10000000:01000000:2.0:1789673067.917927:0:19461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789673067.917979:0:19461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee800/0x6c78c4f8c99664f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673067.917986:0:19461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee800/0x6c78c4f8c99664f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673067.917994:0:19461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee800/0x6c78c4f8c99664f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673067.918016:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738514560:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789673067.918105:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673067.918146:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738514560 00000100:00100000:2.0:1789673067.918153:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738514560 00000100:00100000:2.0:1789673067.918203:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789673067.918213:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4367a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:19461:x1876607738514560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789673067.918226:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673067.918239:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c99664fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99664f4 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673067.918263:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c99664fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99664f4 expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673067.918270:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb46aee000/0x6c78c4f8c99664fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99664f4 expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673067.918276:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee000, rc 0) 00000100:00100000:2.0:1789673067.918304:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4367a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:19461:x1876607738514560:12345-0@lo:101:mount.lustre.0 Request processed in 94us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673067.918315:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789673067.918351:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb419ac540 going to sleep for 11 seconds 00000100:00100000:2.0:1789673067.918369:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738514560:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789673067.918382:0:19461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee800/0x6c78c4f8c99664f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99664fb expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673067.918388:0:19461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee800/0x6c78c4f8c99664f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99664fb expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789673067.922333:0:19461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1789673067.922751:0:19461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789673067.923014:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789673067.923138:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789673067.923160:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789673067.923181:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789673067.923200:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789673067.923306:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789673067.923328:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789673067.923347:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789673067.923366:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789673067.923386:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789673067.923408:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789673067.923429:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789673067.923462:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789673067.923483:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789673067.923503:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789673067.923524:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789673067.923543:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789673067.923562:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789673067.923583:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789673067.923603:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789673067.923623:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789673067.923686:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789673067.923710:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789673067.923734:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789673067.923749:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789673067.923761:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789673067.923773:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789673067.923786:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789673067.923800:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789673067.923820:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789673067.923838:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789673067.923858:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789673067.923878:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789673067.923897:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789673067.923917:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789673067.923937:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789673067.923959:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789673067.923988:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789673067.924002:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1789673067.924015:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1789673067.924129:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1789673067.924150:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1789673067.924169:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1789673067.924190:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1789673067.924210:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1789673067.924242:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1789673067.924271:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1789673067.924280:0:19461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1789673067.924604:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c406a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738514688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789673067.924707:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673067.928467:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc8158bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789673067.928894:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738514688 00000100:00100000:3.0:1789673067.928902:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738514688 00000100:00100000:3.0:1789673067.928962:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789673067.928969:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc43678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:19461:x1876607738514688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789673067.929155:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc43678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:19461:x1876607738514688:12345-0@lo:501:mount.lustre.0 Request processed in 186us (4450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673067.929161:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789673067.929206:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c406a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738514688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789673067.929258:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c406a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738514816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789673067.929304:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673067.929328:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc8158bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789673067.929548:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738514816 00000100:00100000:1.0:1789673067.929555:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738514816 00000100:00100000:1.0:1789673067.929607:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789673067.929615:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc43679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:19461:x1876607738514816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789673067.929745:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc43679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:19461:x1876607738514816:12345-0@lo:503:mount.lustre.0 Request processed in 130us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673067.929752:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789673067.933124:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c406a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738514816:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789673067.933777:0:19461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789673067.933870:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738514944:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789673067.933946:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673067.933992:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43171900 going to sleep for 11 seconds 00000100:00100000:1.0:1789673067.934691:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738514944 00000100:00100000:1.0:1789673067.934700:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738514944 00000100:00100000:1.0:1789673067.935341:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789673067.935354:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4367b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:19461:x1876607738514944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789673067.935506:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4367b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:19461:x1876607738514944:12345-0@lo:502:mount.lustre.0 Request processed in 155us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673067.935514:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789673067.935687:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738514944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789673067.935916:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789673067.935950:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789673067.935968:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789673067.935985:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789673067.936004:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789673067.936025:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789673067.936044:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789673067.936092:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789673067.936111:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789673067.936126:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789673067.936141:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789673067.938185:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789673067.938207:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789673067.938225:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789673067.938243:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789673067.938260:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789673067.938279:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789673067.938296:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789673067.938312:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789673067.938330:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789673067.938347:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789673067.938365:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789673067.938384:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789673067.938421:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789673067.938444:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1789673067.938463:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1789673067.938483:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1789673067.938502:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1789673067.938522:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1789673067.938541:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1789673067.938570:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1789673067.938588:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1789673067.938606:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1789673067.938624:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1789673067.938643:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1789673067.938687:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1789673067.938708:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1789673067.938726:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1789673067.938743:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1789673067.938777:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1789673067.938800:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1789673067.938817:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1789673067.938837:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1789673067.938858:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1789673067.938876:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1789673067.938892:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1789673067.938911:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1789673067.938930:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1789673067.938993:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738515072:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789673067.939111:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673067.939174:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43171900 going to sleep for 11 seconds 00000100:00100000:1.0:1789673067.939551:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738515072 00000100:00100000:1.0:1789673067.939560:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738515072 00000100:00100000:1.0:1789673067.939615:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789673067.939625:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4367b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:19461:x1876607738515072:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789673067.939782:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4367b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:19461:x1876607738515072:12345-0@lo:502:mount.lustre.0 Request processed in 158us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673067.939791:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789673067.940175:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738515072:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789673067.940422:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1789673067.940454:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1789673067.940488:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4121bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738515200:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789673067.940539:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673067.940574:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738515200 00000100:00100000:2.0:1789673067.940579:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738515200 00000100:00100000:2.0:1789673067.940611:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789673067.940619:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc43679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:19461:x1876607738515200:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789673067.940724:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb419ac600 going to sleep for 11 seconds 00000100:00100000:2.0:1789673067.940735:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc43679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:19461:x1876607738515200:12345-0@lo:502:mount.lustre.0 Request processed in 115us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673067.940742:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789673067.940746:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4121bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738515200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789673067.940803:0:19461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1789673067.940812:0:19461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789673067.944160:0:19474:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789673067.944179:0:19474:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cfc7c678000) 00000020:00000080:3.0:1789673067.944209:0:19474:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789673067.944312:0:19474:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfb467e4000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789673067.944317:0:19474:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfb467e4000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789673067.944319:0:19474:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfb467e4000 3 00010000:00080000:3.0:1789673067.944358:0:19474:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfb4754a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.150@tcp at head 00010000:00010000:3.0:1789673067.947356:0:19474:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789673067.947699:0:19474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789673067.947752:0:19474:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789673067.947767:0:19474:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6c78c4f8c9966509 00000100:00080000:3.0:1789673067.947778:0:19474:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789673067.947790:0:19474:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cfb4754a800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:3.0:1789673067.948012:0:19474:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7c407800 x1876607738515328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789673067.948038:0:19474:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789673067.951883:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876607738515328:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789673067.951982:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1789673067.957810:0:19474:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789673067.957833:0:19474:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8cfc745919c0) 00000020:00000080:2.0:1789673067.957887:0:19474:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1789673067.957993:0:19474:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cfb467e4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789673067.957998:0:19474:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cfb467e4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789673067.958000:0:19474:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cfb467e4000 3 00010000:00080000:2.0:1789673067.958049:0:19474:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cfb45ba6800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.150@tcp at head 00000100:00100000:1.0:1789673067.962630:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738515328 00000100:00100000:1.0:1789673067.962647:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738515328 00000100:00100000:1.0:1789673067.969769:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789673067.969785:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1876607738515328:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789673067.969826:0:17140:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:1.0:1789673067.970452:0:17140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6c78c4f8c9966517 00000004:00100000:1.0:1789673067.970480:0:17140:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789673067.970527:0:17140:0:(import.c:65:import_set_state_nolock()) ffff8cfb4757e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789673067.970636:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1876607738515328:12345-0@lo:38:llog_process_th.0 Request processed in 851us (18653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673067.970646:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789673067.971551:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc7c407800 x1876607738515328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789673077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673067.971565:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789673067.971574:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789673067.971583:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789673067.971588:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789673067.971591:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb4754a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789673067.971596:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1876607738515328:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1789673067.975839:0:19474:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1789673067.976097:0:19474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789673067.976159:0:19474:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789673067.976175:0:19474:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x6c78c4f8c996651e 00000100:00080000:2.0:1789673067.976187:0:19474:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789673067.976201:0:19474:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8cfb45ba6800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:2.0:1789673067.976237:0:19474:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc41218e00 x1876607738515456/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789673067.976274:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1876607738515456:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789673067.976350:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673067.976421:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738515456 00000100:00100000:2.0:1789673067.976429:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738515456 00000100:00100000:2.0:1789673067.976469:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789673067.976478:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1876607738515456:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789673067.976515:0:17138:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:2.0:1789673067.976545:0:17138:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x6c78c4f8c9966525 00000004:00100000:2.0:1789673067.976559:0:17138:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789673067.976592:0:17138:0:(import.c:65:import_set_state_nolock()) ffff8cfb45ba7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789673067.976641:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1876607738515456:12345-0@lo:38:llog_process_th.0 Request processed in 164us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673067.976650:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789673067.976710:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cfc41218e00 x1876607738515456/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789673077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673067.976721:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789673067.976728:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789673067.976735:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789673067.976739:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789673067.976742:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfb45ba6800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789673067.976747:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1876607738515456:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789673067.976771:0:19474:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1789673067.977402:0:19474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1789673067.977553:0:19461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789673067.977596:0:19461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789673067.977617:0:19461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee800/0x6c78c4f8c99664f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99664fb expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673067.977630:0:19461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfb46aee800/0x6c78c4f8c99664f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99664fb expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789673067.977704:0:19461:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789673067.977706:0:19461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789673067.977708:0:19461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789673067.977710:0:19461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789673067.977711:0:19461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789673067.977712:0:19461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789673067.977714:0:19461:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789673067.977715:0:19461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789673067.977717:0:19461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789673067.977721:0:19461:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789673067.977724:0:19461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789673067.977726:0:19461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789673067.977728:0:19461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789673067.977729:0:19461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789673067.977800:0:19461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789673067.977803:0:19461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789673067.977804:0:19461:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789673067.977806:0:19461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789673067.977807:0:19461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789673067.977829:0:19461:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789673067.977845:0:19461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738515584:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789673067.977923:0:19461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673067.978054:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738515584 00000100:00100000:2.0:1789673067.978061:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738515584 00000100:00100000:2.0:1789673067.978118:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789673067.978129:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4367a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:19461:x1876607738515584:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789673067.978156:0:17132:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789673067.978172:0:17132:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789673067.978470:0:19461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb474650c0 going to sleep for 11 seconds 20000000:01000000:2.0:1789673067.983022:0:17132:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789673067.983045:0:17132:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789673067.983506:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4367a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:19461:x1876607738515584:12345-0@lo:253:mount.lustre.0 Request processed in 5364us (5566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673067.983530:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789673067.983616:0:19461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:19461:1876607738515584:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789673067.983634:0:19461:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789673067.983638:0:19461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789673067.983641:0:19461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789673067.983643:0:19461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789673067.983645:0:19461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789673067.983647:0:19461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789673067.983649:0:19461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789673067.983650:0:19461:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789673067.983652:0:19461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789673067.983654:0:19461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789673067.984235:0:19461:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789673067.984614:0:17154:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789673067.984620:0:17154:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789673067.984640:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c996652c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673067.984654:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c99663dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99663d5 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673067.984724:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfb482e4600/0x6c78c4f8c99663ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99663e3 expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673067.984738:0:17154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c996652c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673067.984770:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfb482e4600/0x6c78c4f8c99663ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c99663e3 expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673067.984784:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfb482e4600/0x6c78c4f8c99663ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c99663e3 expref: 23 pid: 17133 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673067.984799:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d939180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876607738515712:0@lo:104: 00000100:00100000:0.0:1789673067.984849:0:17154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789673067.984896:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c99663dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c99663d5 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673067.984903:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c99663dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c99663d5 expref: 23 pid: 17131 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673067.984910:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d938a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876607738515840:0@lo:104: 00000100:00100000:0.0:1789673067.984929:0:17154:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673067.984946:0:17154:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc431710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789673067.986178:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738515712 00000100:00100000:3.0:1789673067.986188:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738515712 00000100:00100000:3.0:1789673067.986233:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738515840 00000100:00100000:3.0:1789673067.986236:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738515840 00000100:00100000:3.0:1789673067.986252:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789673067.986262:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+4:17154:x1876607738515712:12345-0@lo:104: 00010000:00010000:3.0:1789673067.986277:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc52435600/0x6c78c4f8c99663e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99663ea expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.986381:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789673067.986387:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+4:17154:x1876607738515712:12345-0@lo:104: Request processed in 127us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673067.986404:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789673067.986423:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789673067.986430:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+3:17154:x1876607738515840:12345-0@lo:104: 00010000:00010000:3.0:1789673067.986568:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5c00/0x6c78c4f8c99663d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99663dc expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.986629:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789673067.986634:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+3:17154:x1876607738515840:12345-0@lo:104: Request processed in 206us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673067.986641:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789673067.986687:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789673067.986694:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc52435600/0x6c78c4f8c99663e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99663ea expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.986702:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435600 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:3.0:1789673067.986707:0:17126:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52435600/0x6c78c4f8c99663e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c99663ea expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.986716:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc52435600/0x6c78c4f8c99663e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c99663ea expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789673067.986723:0:17126:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52435600/0x6c78c4f8c99663e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c99663ea expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789673067.986729:0:17126:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789673067.986766:0:17126:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc52435600/0x6c78c4f8c99663e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99663ea expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.986773:0:17126:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789673067.986795:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc52435600/0x6c78c4f8c99663e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99663ea expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.986804:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc52435600/0x6c78c4f8c99663e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99663ea expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.986829:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789673067.986831:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5c00/0x6c78c4f8c99663d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99663dc expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.986837:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5c00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:3.0:1789673067.986840:0:17126:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5c00/0x6c78c4f8c99663d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c99663dc expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.986847:0:17126:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5c00/0x6c78c4f8c99663d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c99663dc expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789673067.986853:0:17126:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5c00/0x6c78c4f8c99663d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c99663dc expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789673067.986858:0:17126:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789673067.986873:0:17126:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5c00/0x6c78c4f8c99663d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99663dc expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.986878:0:17126:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789673067.986894:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5c00/0x6c78c4f8c99663d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99663dc expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.986901:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfb482e5c00/0x6c78c4f8c99663d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99663dc expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.986915:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673067.986916:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673067.986918:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673067.986924:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789673067.986951:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3638:1876607738515968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789673067.986988:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673067.987301:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3635:1876607738516096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789673067.987328:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673067.987365:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738515968 00000100:00100000:3.0:1789673067.987370:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738515968 00000100:00100000:1.0:1789673067.987836:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d939180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876607738515712:0@lo:104: 00000100:00100000:1.0:1789673067.987850:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d938a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17154:1876607738515840:0@lo:104: 00010000:00010000:1.0:1789673067.987876:0:17154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c996652c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.987962:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfb482e4600/0x6c78c4f8c99663ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99663e3 expref: 24 pid: 17133 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673067.987999:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738516096 00000100:00100000:3.0:1789673067.988004:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738516096 00010000:00010000:3.0:1789673067.988029:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c99663dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99663d5 expref: 25 pid: 17131 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673067.988037:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789673067.988051:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+25:3638:x1876607738515968:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789673067.988059:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789673067.988066:0:18673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789673067.988082:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c407b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+25:3635:x1876607738516096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789673067.988085:0:18673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfb482e4600/0x6c78c4f8c99663ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99663e3 expref: 25 pid: 17133 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.988094:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789673067.988101:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c99663dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99663d5 expref: 25 pid: 17131 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673067.988102:0:18673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfb482e4600/0x6c78c4f8c99663ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c99663e3 expref: 25 pid: 17133 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.988126:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c99663dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c99663d5 expref: 25 pid: 17131 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673067.988850:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfb482e4600/0x6c78c4f8c99663ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c99663e3 expref: 25 pid: 17133 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673067.988870:0:18673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789673067.988957:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:3638:x1876607738515968:12345-0@lo:103:ldlm_bl.0 Request processed in 911us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673067.988965:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789673067.990173:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3638:1876607738515968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789673067.991048:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c99663dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c99663d5 expref: 23 pid: 17131 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.991081:0:17125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c996652c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.991090:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c996652c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789673067.991118:0:17125:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006498428s 00010000:00010000:3.0:1789673067.991124:0:17125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c996652c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.991131:0:17125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c996652c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.991140:0:17125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c996652c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.991148:0:17125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c996652c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.991154:0:17125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc400 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789673067.991158:0:17125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c996652c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.991166:0:17125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c996652c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.991190:0:17125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c996652c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673067.991202:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789673067.991242:0:17154:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c996652c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673067.991254:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c996652c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673067.991273:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8cc400/0x6c78c4f8c996652c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673067.991291:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c407b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:3635:x1876607738516096:12345-0@lo:103:ldlm_bl.0 Request processed in 3222us (3959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673067.991301:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00000004:2.0:1789673067.992816:0:19461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789673067.994650:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3635:1876607738516096:0@lo:103:ldlm_bl.0 00002000:00080000:2.0:1789673068.001288:0:19461:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789673068.001300:0:19461:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789673068.001341:0:19461:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789673068.001397:0:19461:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.150@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789673068.001423:0:19461:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789673068.001454:0:19461:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789673068.002428:0:19461:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789673068.002710:0:19461:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789673068.625327:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789673068.918147:0:19528:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789673068.918486:0:19528:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1789673069.076966:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789673069.636623:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789673069.699724:0:17135:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789673069.699739:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfb46b12800 from 10 10000000:01000000:3.0:1789673069.699744:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789673069.699790:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887800/0x6c78c4f8c9966533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673069.699801:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887800/0x6c78c4f8c9966533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673069.699812:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887800/0x6c78c4f8c9966533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673069.699837:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738516224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789673069.699909:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673069.699966:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551600 going to sleep for 11 seconds 00000100:00100000:1.0:1789673069.700036:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738516224 00000100:00100000:1.0:1789673069.700053:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738516224 00000100:00100000:1.0:1789673069.700120:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789673069.700129:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc43678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:17135:x1876607738516224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789673069.700143:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789673069.700157:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc52434600/0x6c78c4f8c996653a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9966533 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673069.700180:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc52434600/0x6c78c4f8c996653a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9966533 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673069.700190:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc52434600/0x6c78c4f8c996653a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9966533 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673069.700200:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc52434600, rc 0) 00000100:00100000:1.0:1789673069.700239:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc43678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:17135:x1876607738516224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673069.700245:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789673069.700333:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738516224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789673069.700347:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887800/0x6c78c4f8c9966533 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996653a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673069.700356:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887800/0x6c78c4f8c9966533 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c996653a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673069.700408:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738516352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789673069.700441:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673069.700467:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551600 going to sleep for 11 seconds 00000100:00100000:1.0:1789673069.701960:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738516352 00000100:00100000:1.0:1789673069.701976:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738516352 00000100:00100000:1.0:1789673069.702083:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789673069.702093:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4367a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:17135:x1876607738516352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789673069.702118:0:17132:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789673069.702141:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789673069.702149:0:17132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789673069.702276:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4367a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:17135:x1876607738516352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 185us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673069.702284:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789673069.702400:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738516352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789673069.702475:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789673069.702485:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887800/0x6c78c4f8c9966533 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996653a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673069.702504:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887800/0x6c78c4f8c9966533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c996653a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789673069.702516:0:17135:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789673069.702519:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cfc7f765000 from 10 10000000:01000000:3.0:1789673069.702522:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789673069.702550:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887400/0x6c78c4f8c9966541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673069.702558:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887400/0x6c78c4f8c9966541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673069.702566:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887400/0x6c78c4f8c9966541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673069.702585:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738516480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789673069.702618:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673069.702684:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551600 going to sleep for 11 seconds 00000100:00100000:2.0:1789673069.702749:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738516480 00000100:00100000:2.0:1789673069.702755:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738516480 00000100:00100000:2.0:1789673069.702798:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789673069.702806:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc43678c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:17135:x1876607738516480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789673069.702815:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673069.702828:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb46aef800/0x6c78c4f8c9966548 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c9966541 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673069.702857:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb46aef800/0x6c78c4f8c9966548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c9966541 expref: 24 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673069.702868:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb46aef800/0x6c78c4f8c9966548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9966541 expref: 24 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673069.702876:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef800, rc 0) 00000100:00100000:2.0:1789673069.702907:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc43678c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:17135:x1876607738516480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673069.702914:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789673069.703025:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738516480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789673069.703037:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887400/0x6c78c4f8c9966541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966548 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673069.703059:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887400/0x6c78c4f8c9966541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c9966548 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673069.703101:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7c405f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738516608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789673069.703130:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673069.703165:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c551600 going to sleep for 11 seconds 00000100:00100000:2.0:1789673069.703204:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738516608 00000100:00100000:2.0:1789673069.703208:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738516608 00000100:00100000:2.0:1789673069.703237:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789673069.703243:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc43679050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:17135:x1876607738516608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789673069.703254:0:17131:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789673069.703267:0:17131:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789673069.703270:0:17131:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789673069.703343:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc43679050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:17135:x1876607738516608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673069.703351:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789673069.703413:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7c405f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738516608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789673069.703460:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789673069.703467:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887400/0x6c78c4f8c9966541 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966548 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673069.703475:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887400/0x6c78c4f8c9966541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c9966548 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673070.405228:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738516736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789673070.405314:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673070.406123:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738516736 00000100:00100000:0.0:1789673070.406134:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738516736 00000100:00100000:0.0:1789673070.406205:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789673070.406216:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738516736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789673070.406250:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789673070.411873:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738516736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5647us (6546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673070.411889:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789673070.411931:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789673070.418352:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738516736:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789673070.661831:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789673071.430132:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738516864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789673071.430221:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673071.431218:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738516864 00000100:00100000:1.0:1789673071.431230:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738516864 00000100:00100000:1.0:1789673071.431302:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789673071.431313:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738516864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789673071.431357:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789673071.431430:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738516864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673071.431437:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789673071.431636:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738516992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789673071.431717:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673071.431755:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738516864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789673071.435883:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738516992 00000100:00100000:2.0:1789673071.435896:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738516992 00000100:00100000:2.0:1789673071.435961:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789673071.435972:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738516992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789673071.436051:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789673071.436141:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738516992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 171us (4422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673071.436147:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789673071.436831:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738516992:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789673071.686432:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789673072.453511:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738517120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789673072.453598:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673072.453704:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738517120 00000100:00100000:2.0:1789673072.453712:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738517120 00000100:00100000:2.0:1789673072.453784:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789673072.453796:0:18650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738517120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789673072.453832:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789673072.453880:0:18650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738517120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673072.453887:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789673072.453936:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738517120:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789673072.454089:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789673072.707996:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789673073.476182:0:18407:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673073.476189:0:18407:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789673073.476193:0:18407:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789673073.476203:0:18407:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 545 00000100:00080000:1.0:1789673073.476208:0:18407:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789673073.476220:0:18407:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cfc458c7800 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789673073.476242:0:18407:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d8de680 x1876607738517632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789673073.476278:0:18407:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789673073.476281:0:18407:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789673073.476283:0:18407:0:(import.c:65:import_set_state_nolock()) ffff8cfc6173d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789673073.476293:0:18407:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 545 00000100:00080000:1.0:1789673073.476296:0:18407:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789673073.476302:0:18407:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cfc6173d000 using connection 192.168.201.150@tcp/0@lo 00000100:00100000:1.0:1789673073.476316:0:18407:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cfc7d868a80 x1876607738518144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789673073.476378:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3636:1876607738517248:0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.476453:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.476503:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738517888:0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.476529:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.476549:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738518528:0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.476573:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.476597:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789673073.476603:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738517760:0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.476624:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.476641:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876607738518400:0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.476680:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.476706:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738517376:0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.476729:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.476747:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738518016:0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.476769:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.476785:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d869f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738518656:0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.476811:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.476824:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789673073.476829:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738517504:0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.476862:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.476881:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d86b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738518272:0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.476901:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.476912:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738518784:0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.476951:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.477007:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738517632:0@lo:8:kworker.0 00000100:00100000:1.0:1789673073.477031:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.477049:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738518144:0@lo:8:kworker.0 00000100:00100000:1.0:1789673073.477070:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.477105:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738517248 00000100:00100000:1.0:1789673073.477113:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738517248 00000100:00100000:1.0:1789673073.477158:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789673073.477166:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc43678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:3636:x1876607738517248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.477210:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc43678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:3636:x1876607738517248:12345-0@lo:400:kworker.0 Request processed in 45us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673073.477216:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789673073.477245:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738517888 00000100:00100000:1.0:1789673073.477249:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738517888 00000100:00100000:1.0:1789673073.477268:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738517376 00000100:00100000:1.0:1789673073.477271:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738517376 00000100:00100000:1.0:1789673073.477282:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789673073.477288:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738517888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.477318:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d868e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738517888:12345-0@lo:400:kworker.0 Request processed in 30us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673073.477323:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789673073.477332:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789673073.477344:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738517376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.477379:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d868700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738517376:12345-0@lo:400:kworker.0 Request processed in 35us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673073.477385:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789673073.477404:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738518528 00000100:00100000:1.0:1789673073.477407:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738518528 00000100:00100000:1.0:1789673073.477436:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738517760 00000100:00100000:1.0:1789673073.477439:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738517760 00000100:00100000:1.0:1789673073.477448:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738518400 00000100:00100000:1.0:1789673073.477450:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738518400 00000100:00100000:1.0:1789673073.477467:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738518656 00000100:00100000:1.0:1789673073.477469:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738518656 00000100:00100000:1.0:1789673073.477481:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738518272 00000100:00100000:1.0:1789673073.477483:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738518272 00000100:00100000:1.0:1789673073.477494:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738518784 00000100:00100000:1.0:1789673073.477496:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738518784 00000100:00100000:1.0:1789673073.477511:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789673073.477516:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738518528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.477548:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738518528:12345-0@lo:400:kworker.0 Request processed in 31us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673073.477554:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789673073.477568:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789673073.477574:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738517760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.477600:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1876607738517760:12345-0@lo:400:kworker.0 Request processed in 27us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673073.477606:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789673073.477616:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789673073.477621:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876607738518400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.477681:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d869880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1876607738518400:12345-0@lo:400:kworker.0 Request processed in 59us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673073.477688:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789673073.477700:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789673073.477705:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738518656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673073.478113:0:17140:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789673073.478126:0:17140:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789673073.478146:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738518016 00000100:00100000:3.0:1789673073.478151:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738518016 00000100:00100000:3.0:1789673073.478179:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738517504 00000100:00100000:3.0:1789673073.478182:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738517504 00000100:00100000:3.0:1789673073.478195:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738517632 00000100:00100000:3.0:1789673073.478197:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738517632 00000100:00100000:3.0:1789673073.478209:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738518144 00000100:00100000:3.0:1789673073.478212:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738518144 00000100:00100000:3.0:1789673073.478223:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789673073.478230:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738518016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673073.478271:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738518016:12345-0@lo:400:kworker.0 Request processed in 42us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673073.478286:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789673073.478299:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789673073.478305:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738517504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673073.478335:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738517504:12345-0@lo:400:kworker.0 Request processed in 31us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673073.478340:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789673073.478351:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789673073.478355:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1876607738517632:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789673073.478384:0:18647:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:3.0:1789673073.478413:0:18647:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6c78c4f8c996654f 00002000:00100000:3.0:1789673073.478428:0:18647:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cfb4754d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789673073.478432:0:18647:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789673073.478435:0:18647:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789673073.478641:0:18647:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789673073.478686:0:18647:0:(import.c:65:import_set_state_nolock()) ffff8cfb4754c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789673073.478730:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1876607738517632:12345-0@lo:8:kworker.0 Request processed in 373us (1698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673073.478736:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789673073.478747:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789673073.478751:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1876607738518144:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789673073.478764:0:18647:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:3.0:1789673073.478781:0:18647:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x6c78c4f8c9966556 00002000:00100000:3.0:1789673073.478788:0:18647:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8cfb4754f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789673073.478792:0:18647:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1789673073.478800:0:18647:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789673073.478824:0:18647:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789673073.478838:0:18647:0:(import.c:65:import_set_state_nolock()) ffff8cfb4754b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789673073.478867:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d869c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3634:x1876607738518144:12345-0@lo:8:kworker.0 Request processed in 115us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673073.478876:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789673073.479395:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d869500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738518656:12345-0@lo:400:kworker.0 Request processed in 1687us (2581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673073.479405:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789673073.479427:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789673073.479435:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738518272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.479490:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738518272:12345-0@lo:400:kworker.0 Request processed in 57us (2587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673073.479498:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789673073.479510:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789673073.479516:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738518784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.479546:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738518784:12345-0@lo:400:kworker.0 Request processed in 30us (2595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673073.479551:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1789673073.479597:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789673073.479601:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789673073.479603:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789673073.479638:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8de680 x1876607738517632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789673098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673073.479650:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789673073.479672:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789673073.479680:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789673073.479691:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789673073.479694:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc458c7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789673073.479712:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789673073.479717:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1876607738517632:0@lo:8:kworker.0 00010000:00080000:1.0:1789673073.479733:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d868a80 x1876607738518144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789673098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673073.479740:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789673073.479744:0:3634:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789673073.479749:0:3634:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789673073.479751:0:3634:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789673073.479753:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8cfc6173d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789673073.479768:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789673073.479771:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1876607738518144:0@lo:8:kworker.0 00000004:00080000:1.0:1789673073.479829:0:17165:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1789673073.479849:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17165:1876607738519040:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789673073.479882:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.479905:0:17165:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb47465240 going to sleep for 11 seconds 00000004:00080000:1.0:1789673073.479929:0:17884:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000004:00080000:3.0:1789673073.480120:0:17164:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789673073.480209:0:17164:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 551395549976ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789673073.480216:0:17164:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789673073.480238:0:17883:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789673073.480315:0:17883:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 551395655584ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789673073.480320:0:17883:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789673073.480508:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738519040 00000100:00100000:3.0:1789673073.480515:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738519040 00000100:00100000:3.0:1789673073.480559:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789673073.480567:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17165:x1876607738519040:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1789673073.484130:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789673073.484196:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738518912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789673073.484272:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.484321:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789673073.484328:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738519168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789673073.484350:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.484391:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738518912 00000100:00100000:1.0:1789673073.484399:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738518912 00000100:00100000:1.0:1789673073.484446:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738519168 00000100:00100000:1.0:1789673073.484449:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738519168 00000100:00100000:1.0:1789673073.484473:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789673073.484481:0:18650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1876607738518912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789673073.484511:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789673073.484557:0:18650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1876607738518912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673073.484564:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789673073.484581:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789673073.484587:0:18650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1876607738519168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789673073.484596:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789673073.484620:0:18650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1876607738519168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673073.484626:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789673073.484643:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789673073.484686:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47906680 x1876607738519168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789673089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673073.484707:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738519168:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789673073.484719:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d868a80 x1876607738518912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789673089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673073.484731:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d868a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738518912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789673073.484795:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738517504:0@lo:400:kworker.0 00010000:00080000:1.0:1789673073.484809:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d86b100 x1876607738518272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673073.484819:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738518272:0@lo:400:kworker.0 00010000:00080000:1.0:1789673073.484844:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d868380 x1876607738518784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673073.484852:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d868380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738518784:0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.484864:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738517376:0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.484875:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738518016:0@lo:400:kworker.0 00010000:00080000:1.0:1789673073.484887:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d869f80 x1876607738518656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673073.484895:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d869f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738518656:0@lo:400:kworker.0 00010000:00080000:1.0:1789673073.487479:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8dd180 x1876607738517760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673073.487498:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1876607738517760:0@lo:400:kworker.0 00010000:00080000:1.0:1789673073.487524:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d86a300 x1876607738518400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673073.487533:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d86a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1876607738518400:0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.487545:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3636:1876607738517248:0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.487557:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738517888:0@lo:400:kworker.0 00010000:00080000:1.0:1789673073.487569:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d869180 x1876607738518528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673073.487577:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d869180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738518528:0@lo:400:kworker.0 00000100:00100000:1.0:1789673073.487711:0:17884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17884:1876607738519296:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789673073.487781:0:17884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.487817:0:17884:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb47465c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789673073.489425:0:19053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738519296 00000100:00100000:3.0:1789673073.489440:0:19053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738519296 00000100:00100000:3.0:1789673073.489493:0:19053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789673073.489503:0:19053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17884:x1876607738519296:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:1.0:1789673073.489812:0:18647:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789673073.489820:0:18647:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789673073.489826:0:18647:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:3.0:1789673073.494117:0:17872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:3.0:1789673073.495449:0:17118:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1789673073.501769:0:19053:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789673073.501784:0:19053:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789673073.501903:0:19053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17884:x1876607738519296:12345-0@lo:7:osp-pre-1-1.0 Request processed in 12395us (14115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673073.501915:0:19053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789673073.502053:0:17884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47906680 x1876607738519296/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789673089 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673073.502069:0:17884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17884:1876607738519296:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1789673073.502085:0:17884:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789673073.502129:0:17884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17884:1876607738519424:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789673073.502167:0:17884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673073.502197:0:17884:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43171000 going to sleep for 11 seconds 00000100:00100000:3.0:1789673073.506228:0:19053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738519424 00000100:00100000:3.0:1789673073.506244:0:19053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738519424 00000100:00100000:3.0:1789673073.506342:0:19053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789673073.506354:0:19053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17884:x1876607738519424:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789673073.506387:0:19053:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789673073.506470:0:19053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17884:x1876607738519424:12345-0@lo:5:osp-pre-1-1.0 Request processed in 119us (4302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673073.506478:0:19053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789673073.506635:0:17884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc41218700 x1876607738519424/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789673089 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789673073.506653:0:17884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17884:1876607738519424:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789673073.506719:0:17884:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789673073.506764:0:17884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17884:1876607738519552:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789673073.506798:0:17884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673073.506820:0:17884:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43171000 going to sleep for 11 seconds 00000100:00100000:2.0:1789673073.506834:0:19053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738519552 00000100:00100000:2.0:1789673073.506837:0:19053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738519552 00000100:00100000:2.0:1789673073.506858:0:19053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789673073.506864:0:19053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17884:x1876607738519552:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789673073.506890:0:19053:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:1.0:1789673073.510571:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789673073.510584:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c996655d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.510602:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789673073.510607:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673073.510614:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c996655d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.510635:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c996655d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.510647:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c996655d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.510885:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c996655d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.511069:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789673073.511083:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673073.511090:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c996655d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.511111:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435600 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673073.511277:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c996655d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.511290:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c996655d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.511309:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c996655d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.511318:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c673aef/0x6c78c4f8c996655d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.511338:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.511340:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.511342:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789673073.512213:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789673073.512222:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000514f8891/0x6c78c4f8c9966564 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.512234:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789673073.512239:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673073.512244:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000514f8891/0x6c78c4f8c9966564 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.512255:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000514f8891/0x6c78c4f8c9966564 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.512272:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000514f8891/0x6c78c4f8c9966564 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.512280:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000514f8891/0x6c78c4f8c9966564 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.512436:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789673073.513098:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789673073.513106:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aa61582/0x6c78c4f8c996656b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.513128:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789673073.513136:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673073.513140:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aa61582/0x6c78c4f8c996656b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.513152:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aa61582/0x6c78c4f8c996656b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.513161:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aa61582/0x6c78c4f8c996656b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.513170:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003aa61582/0x6c78c4f8c996656b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.514103:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789673073.514235:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000514f8891/0x6c78c4f8c9966564 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.514252:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435c00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789673073.514257:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000514f8891/0x6c78c4f8c9966564 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.514268:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000514f8891/0x6c78c4f8c9966564 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.514292:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000514f8891/0x6c78c4f8c9966564 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.514301:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000514f8891/0x6c78c4f8c9966564 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.514327:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789673073.514347:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003aa61582/0x6c78c4f8c996656b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.514366:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52435e00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789673073.514369:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003aa61582/0x6c78c4f8c996656b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.514377:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003aa61582/0x6c78c4f8c996656b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.514388:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003aa61582/0x6c78c4f8c996656b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.514397:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673073.514399:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673073.514400:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.514730:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789673073.514738:0:18647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aa61582/0x6c78c4f8c996656b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789673073.515817:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789673073.515827:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d6f271f/0x6c78c4f8c9966572 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.515841:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789673073.515846:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673073.515852:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d6f271f/0x6c78c4f8c9966572 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.515866:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d6f271f/0x6c78c4f8c9966572 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.515876:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d6f271f/0x6c78c4f8c9966572 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.515885:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d6f271f/0x6c78c4f8c9966572 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.516296:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789673073.516304:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d6f271f/0x6c78c4f8c9966572 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.516312:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434200 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789673073.516316:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d6f271f/0x6c78c4f8c9966572 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.516324:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d6f271f/0x6c78c4f8c9966572 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.516339:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d6f271f/0x6c78c4f8c9966572 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.516362:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673073.516364:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673073.516366:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.516468:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789673073.516475:0:18647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d6f271f/0x6c78c4f8c9966572 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789673073.520836:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789673073.520849:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003448edca/0x6c78c4f8c9966579 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.520868:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789673073.520874:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673073.520881:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003448edca/0x6c78c4f8c9966579 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.521046:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003448edca/0x6c78c4f8c9966579 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.521062:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003448edca/0x6c78c4f8c9966579 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.521082:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003448edca/0x6c78c4f8c9966579 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.521303:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789673073.521312:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003448edca/0x6c78c4f8c9966579 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.521320:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434800 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789673073.521329:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003448edca/0x6c78c4f8c9966579 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.521339:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003448edca/0x6c78c4f8c9966579 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.521356:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003448edca/0x6c78c4f8c9966579 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.521365:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673073.521367:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673073.521368:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673073.521842:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.522024:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789673073.522031:0:18647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003448edca/0x6c78c4f8c9966579 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789673073.522507:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789673073.522514:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e94abf58/0x6c78c4f8c9966580 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.522531:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789673073.522534:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673073.522538:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e94abf58/0x6c78c4f8c9966580 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.522547:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e94abf58/0x6c78c4f8c9966580 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.522554:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e94abf58/0x6c78c4f8c9966580 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.522559:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e94abf58/0x6c78c4f8c9966580 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.522574:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789673073.522929:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789673073.522935:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dea3c64d/0x6c78c4f8c9966587 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.522943:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789673073.522946:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673073.522950:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dea3c64d/0x6c78c4f8c9966587 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.522959:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dea3c64d/0x6c78c4f8c9966587 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.522987:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dea3c64d/0x6c78c4f8c9966587 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.522994:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dea3c64d/0x6c78c4f8c9966587 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523010:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789673073.523018:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789673073.523022:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e94abf58/0x6c78c4f8c9966580 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523029:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4600 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673073.523033:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94abf58/0x6c78c4f8c9966580 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523041:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94abf58/0x6c78c4f8c9966580 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523055:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e94abf58/0x6c78c4f8c9966580 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523063:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e94abf58/0x6c78c4f8c9966580 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523075:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673073.523085:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dea3c64d/0x6c78c4f8c9966587 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523092:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5c00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673073.523095:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dea3c64d/0x6c78c4f8c9966587 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523104:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dea3c64d/0x6c78c4f8c9966587 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523124:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dea3c64d/0x6c78c4f8c9966587 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523132:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dea3c64d/0x6c78c4f8c9966587 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523146:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.523148:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.523150:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789673073.523614:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789673073.523622:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a66482d/0x6c78c4f8c996658e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523632:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789673073.523635:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673073.523639:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a66482d/0x6c78c4f8c996658e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523680:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a66482d/0x6c78c4f8c996658e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523690:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a66482d/0x6c78c4f8c996658e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523698:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a66482d/0x6c78c4f8c996658e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523712:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789673073.523720:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673073.523724:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a66482d/0x6c78c4f8c996658e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523730:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4200 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673073.523733:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a66482d/0x6c78c4f8c996658e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523741:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a66482d/0x6c78c4f8c996658e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523751:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a66482d/0x6c78c4f8c996658e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523758:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a66482d/0x6c78c4f8c996658e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.523789:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.523791:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.523793:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789673073.524215:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789673073.524220:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000972fd02c/0x6c78c4f8c9966595 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524226:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789673073.524229:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673073.524232:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000972fd02c/0x6c78c4f8c9966595 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524238:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000972fd02c/0x6c78c4f8c9966595 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524243:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000972fd02c/0x6c78c4f8c9966595 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524248:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000972fd02c/0x6c78c4f8c9966595 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524257:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789673073.524263:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673073.524265:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000972fd02c/0x6c78c4f8c9966595 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524279:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e5000 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673073.524281:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000972fd02c/0x6c78c4f8c9966595 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524287:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000972fd02c/0x6c78c4f8c9966595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524294:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000972fd02c/0x6c78c4f8c9966595 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524298:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000972fd02c/0x6c78c4f8c9966595 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524309:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.524310:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.524312:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789673073.524581:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789673073.524586:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059ce6f64/0x6c78c4f8c996659c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524593:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789673073.524596:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673073.524598:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059ce6f64/0x6c78c4f8c996659c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524605:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059ce6f64/0x6c78c4f8c996659c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524615:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059ce6f64/0x6c78c4f8c996659c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524620:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059ce6f64/0x6c78c4f8c996659c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524630:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789673073.524635:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673073.524638:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059ce6f64/0x6c78c4f8c996659c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524643:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4800 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673073.524645:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059ce6f64/0x6c78c4f8c996659c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524649:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059ce6f64/0x6c78c4f8c996659c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524655:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059ce6f64/0x6c78c4f8c996659c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524680:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059ce6f64/0x6c78c4f8c996659c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.524689:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.524694:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.524695:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789673073.525144:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789673073.525150:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a611e91b/0x6c78c4f8c99665a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.525159:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789673073.525162:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673073.525166:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a611e91b/0x6c78c4f8c99665a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.525176:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a611e91b/0x6c78c4f8c99665a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.525185:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a611e91b/0x6c78c4f8c99665a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.525192:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a611e91b/0x6c78c4f8c99665a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.525209:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789673073.525215:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673073.525218:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a611e91b/0x6c78c4f8c99665a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.525223:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4e00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673073.525226:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a611e91b/0x6c78c4f8c99665a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.525241:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a611e91b/0x6c78c4f8c99665a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.525249:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a611e91b/0x6c78c4f8c99665a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.525254:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a611e91b/0x6c78c4f8c99665a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.525264:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.525265:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.525266:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673073.525403:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789673073.525879:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789673073.525886:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fbae90e/0x6c78c4f8c99665aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.525895:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789673073.526509:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673073.526515:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fbae90e/0x6c78c4f8c99665aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.526526:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fbae90e/0x6c78c4f8c99665aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.526534:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fbae90e/0x6c78c4f8c99665aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.526545:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fbae90e/0x6c78c4f8c99665aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.526561:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789673073.526571:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673073.526574:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fbae90e/0x6c78c4f8c99665aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.526579:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4400 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673073.526582:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fbae90e/0x6c78c4f8c99665aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.526587:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fbae90e/0x6c78c4f8c99665aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.526596:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fbae90e/0x6c78c4f8c99665aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.526601:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fbae90e/0x6c78c4f8c99665aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.526614:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.526615:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.526616:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789673073.527371:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789673073.527386:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000076d111a/0x6c78c4f8c99665b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.527395:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1789673073.527397:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673073.527401:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000076d111a/0x6c78c4f8c99665b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.527407:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000076d111a/0x6c78c4f8c99665b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.527413:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000076d111a/0x6c78c4f8c99665b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.527418:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000076d111a/0x6c78c4f8c99665b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.527434:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789673073.527517:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789673073.527522:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000076d111a/0x6c78c4f8c99665b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.527536:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4c00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789673073.527538:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000076d111a/0x6c78c4f8c99665b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.527544:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000076d111a/0x6c78c4f8c99665b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.527552:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000076d111a/0x6c78c4f8c99665b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.527556:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000076d111a/0x6c78c4f8c99665b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.527568:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673073.527569:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673073.527570:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673073.528398:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673073.528404:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c99665b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.528412:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789673073.528415:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673073.528418:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c99665b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.528424:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c99665b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.528435:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c99665b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.528439:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c99665b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.528855:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789673073.529055:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789673073.529063:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c99665b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.529071:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887000 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:1.0:1789673073.529076:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c99665b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.529086:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c99665b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.529108:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c99665b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.529115:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe6fb7e0/0x6c78c4f8c99665b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673073.529134:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.529136:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789673073.529139:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673073.529942:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673073.529951:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086e5013b/0x6c78c4f8c99665bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.529962:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789673073.529966:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673073.529971:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086e5013b/0x6c78c4f8c99665bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.529992:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086e5013b/0x6c78c4f8c99665bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.530002:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086e5013b/0x6c78c4f8c99665bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.530009:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086e5013b/0x6c78c4f8c99665bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.530187:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789673073.530197:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789673073.530202:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086e5013b/0x6c78c4f8c99665bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.530211:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886400 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789673073.530214:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086e5013b/0x6c78c4f8c99665bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.530223:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086e5013b/0x6c78c4f8c99665bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.530236:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086e5013b/0x6c78c4f8c99665bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.530244:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086e5013b/0x6c78c4f8c99665bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.530261:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673073.530263:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673073.530264:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673073.530953:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673073.530960:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cf57cc/0x6c78c4f8c99665c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.530971:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789673073.530991:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673073.530996:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088cf57cc/0x6c78c4f8c99665c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.531007:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088cf57cc/0x6c78c4f8c99665c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.531016:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088cf57cc/0x6c78c4f8c99665c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.531023:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088cf57cc/0x6c78c4f8c99665c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.531048:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789673073.531118:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789673073.531127:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088cf57cc/0x6c78c4f8c99665c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.531137:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886e00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789673073.531141:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cf57cc/0x6c78c4f8c99665c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.531151:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088cf57cc/0x6c78c4f8c99665c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.531170:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088cf57cc/0x6c78c4f8c99665c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.531179:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088cf57cc/0x6c78c4f8c99665c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.531217:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.531219:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.531221:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673073.531439:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673073.531452:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7d30538/0x6c78c4f8c99665cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.531459:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789673073.531461:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673073.531464:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d30538/0x6c78c4f8c99665cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.531470:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7d30538/0x6c78c4f8c99665cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.531475:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7d30538/0x6c78c4f8c99665cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.531485:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d30538/0x6c78c4f8c99665cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.531501:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789673073.531757:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673073.531762:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007057d632/0x6c78c4f8c99665d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.531768:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789673073.531775:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7d30538/0x6c78c4f8c99665cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.531780:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789673073.531786:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673073.531795:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007057d632/0x6c78c4f8c99665d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.531795:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886600 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789673073.531802:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7d30538/0x6c78c4f8c99665cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.531806:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007057d632/0x6c78c4f8c99665d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.531819:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7d30538/0x6c78c4f8c99665cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.531820:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007057d632/0x6c78c4f8c99665d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.531844:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007057d632/0x6c78c4f8c99665d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.531849:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7d30538/0x6c78c4f8c99665cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.531859:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7d30538/0x6c78c4f8c99665cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.531860:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789673073.531881:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789673073.531886:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007057d632/0x6c78c4f8c99665d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.531893:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887600 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789673073.531903:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007057d632/0x6c78c4f8c99665d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.531914:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007057d632/0x6c78c4f8c99665d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.531925:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007057d632/0x6c78c4f8c99665d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.532012:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007057d632/0x6c78c4f8c99665d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.532029:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.532031:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.532033:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.532040:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673073.532214:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673073.532220:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081b68802/0x6c78c4f8c99665db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.532235:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789673073.532238:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673073.532242:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081b68802/0x6c78c4f8c99665db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.532259:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081b68802/0x6c78c4f8c99665db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.532267:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081b68802/0x6c78c4f8c99665db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.532275:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081b68802/0x6c78c4f8c99665db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.532294:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789673073.532301:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789673073.532307:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081b68802/0x6c78c4f8c99665db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.532315:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886200 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789673073.532319:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081b68802/0x6c78c4f8c99665db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.532329:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081b68802/0x6c78c4f8c99665db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.532391:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081b68802/0x6c78c4f8c99665db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.532405:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081b68802/0x6c78c4f8c99665db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.532418:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.532420:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.532421:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673073.532572:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673073.532576:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99665e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.532582:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789673073.532584:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673073.532587:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99665e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.532593:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99665e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.532606:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99665e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.532611:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99665e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.532626:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789673073.532877:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673073.532882:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a8cf6bc/0x6c78c4f8c99665e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.532890:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789673073.532893:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673073.532898:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a8cf6bc/0x6c78c4f8c99665e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.532907:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a8cf6bc/0x6c78c4f8c99665e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.532915:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a8cf6bc/0x6c78c4f8c99665e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.532923:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a8cf6bc/0x6c78c4f8c99665e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.532953:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789673073.533083:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789673073.533089:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99665e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533097:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886000 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789673073.533100:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99665e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533108:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99665e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533119:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99665e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533126:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d102a91f/0x6c78c4f8c99665e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533141:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789673073.533144:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a8cf6bc/0x6c78c4f8c99665e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533155:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886800 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789673073.533158:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a8cf6bc/0x6c78c4f8c99665e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533165:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a8cf6bc/0x6c78c4f8c99665e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533174:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a8cf6bc/0x6c78c4f8c99665e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533180:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a8cf6bc/0x6c78c4f8c99665e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533196:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.533198:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.533199:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.533206:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673073.533229:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673073.533233:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c99665f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.533241:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789673073.533243:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673073.533246:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c99665f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.533252:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c99665f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.533257:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c99665f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.533263:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c99665f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.533277:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789673073.533315:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789673073.533321:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c99665f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533326:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887200 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789673073.533330:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c99665f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533392:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c99665f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533411:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c99665f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533418:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be352c43/0x6c78c4f8c99665f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533432:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.533434:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.533435:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673073.533560:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673073.533565:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a09c4750/0x6c78c4f8c99665f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.533571:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789673073.533578:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673073.533581:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a09c4750/0x6c78c4f8c99665f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.533840:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a09c4750/0x6c78c4f8c99665f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.533850:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a09c4750/0x6c78c4f8c99665f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.533858:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a09c4750/0x6c78c4f8c99665f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.533883:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789673073.533892:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789673073.533898:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a09c4750/0x6c78c4f8c99665f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533908:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886c00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789673073.533912:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a09c4750/0x6c78c4f8c99665f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.533919:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a09c4750/0x6c78c4f8c99665f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.534008:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a09c4750/0x6c78c4f8c99665f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.534018:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a09c4750/0x6c78c4f8c99665f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.534044:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.534046:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.534048:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673073.534340:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673073.534347:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f4cfe0d/0x6c78c4f8c99665fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.534355:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789673073.534358:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673073.534363:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f4cfe0d/0x6c78c4f8c99665fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.534372:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f4cfe0d/0x6c78c4f8c99665fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.534381:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f4cfe0d/0x6c78c4f8c99665fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.534391:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f4cfe0d/0x6c78c4f8c99665fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.534573:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789673073.534594:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789673073.534600:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f4cfe0d/0x6c78c4f8c99665fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.534608:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887c00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789673073.534748:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f4cfe0d/0x6c78c4f8c99665fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.534758:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f4cfe0d/0x6c78c4f8c99665fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.534770:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f4cfe0d/0x6c78c4f8c99665fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.534778:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f4cfe0d/0x6c78c4f8c99665fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.534792:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.534793:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.534795:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673073.535074:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673073.535225:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065322092/0x6c78c4f8c9966605 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.535235:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789673073.535239:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673073.535243:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065322092/0x6c78c4f8c9966605 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.535253:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065322092/0x6c78c4f8c9966605 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.535261:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065322092/0x6c78c4f8c9966605 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.535269:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065322092/0x6c78c4f8c9966605 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.535282:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789673073.535595:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789673073.535602:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065322092/0x6c78c4f8c9966605 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.535763:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886a00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789673073.535766:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065322092/0x6c78c4f8c9966605 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.535774:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065322092/0x6c78c4f8c9966605 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.535785:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065322092/0x6c78c4f8c9966605 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.535792:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065322092/0x6c78c4f8c9966605 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.535807:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.535809:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.535810:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789673073.535889:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673073.535894:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bff65261/0x6c78c4f8c996660c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.535904:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789673073.535906:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673073.535909:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff65261/0x6c78c4f8c996660c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.535915:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bff65261/0x6c78c4f8c996660c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.535921:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bff65261/0x6c78c4f8c996660c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.535929:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bff65261/0x6c78c4f8c996660c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.535945:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789673073.537221:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673073.537228:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001235aff5/0x6c78c4f8c9966613 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.537239:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789673073.537241:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673073.537245:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001235aff5/0x6c78c4f8c9966613 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.537253:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001235aff5/0x6c78c4f8c9966613 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.537267:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001235aff5/0x6c78c4f8c9966613 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.537272:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001235aff5/0x6c78c4f8c9966613 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.537280:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789673073.538089:0:18647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789673073.538096:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006348f62d/0x6c78c4f8c996661a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.538106:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1789673073.538118:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673073.538123:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006348f62d/0x6c78c4f8c996661a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.538132:0:18647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006348f62d/0x6c78c4f8c996661a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.538141:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006348f62d/0x6c78c4f8c996661a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.538148:0:18647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006348f62d/0x6c78c4f8c996661a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.538170:0:18647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:3.0:1789673073.538209:0:18647:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1789673073.538313:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17165:x1876607738519040:12345-0@lo:5:osp-pre-1-0.0 Request processed in 57743us (58425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673073.538325:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789673073.538526:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17165:1876607738519040:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789673073.538544:0:17165:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1789673073.538595:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17165:1876607738519680:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789673073.538633:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.538681:0:17165:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc8158b780 going to sleep for 11 seconds 00000100:00100000:1.0:1789673073.538700:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738519680 00000100:00100000:1.0:1789673073.538706:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738519680 00000100:00100000:1.0:1789673073.538742:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789673073.538751:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17165:x1876607738519680:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789673073.538903:0:18648:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000001:00080000:3.0:1789673073.539359:0:19462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1789673073.539396:0:19462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789673073.539400:0:19462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789673073.539787:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789673073.539797:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bff65261/0x6c78c4f8c996660c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.539809:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47477a00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789673073.539813:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bff65261/0x6c78c4f8c996660c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.539824:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bff65261/0x6c78c4f8c996660c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.539852:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bff65261/0x6c78c4f8c996660c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.539860:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bff65261/0x6c78c4f8c996660c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673073.539865:0:17127:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789673073.539891:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789673073.539896:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006348f62d/0x6c78c4f8c996661a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.539904:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47476c00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789673073.539907:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006348f62d/0x6c78c4f8c996661a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.539915:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006348f62d/0x6c78c4f8c996661a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.539926:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006348f62d/0x6c78c4f8c996661a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.540013:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006348f62d/0x6c78c4f8c996661a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.540029:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.540031:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.540039:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789673073.540239:0:19053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17884:x1876607738519552:12345-0@lo:5:osp-pre-1-1.0 Request processed in 33373us (33439us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789673073.540249:0:19053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789673073.540296:0:17884:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789673073.540304:0:17884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17884:1876607738519552:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789673073.540326:0:17884:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789673073.540373:0:17884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17884:1876607738519808:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789673073.540407:0:17884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673073.540433:0:17884:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc8158b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789673073.540925:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738519808 00000100:00100000:1.0:1789673073.540933:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738519808 00000100:00100000:1.0:1789673073.540980:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789673073.540989:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17884:x1876607738519808:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789673073.541043:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17884:x1876607738519808:12345-0@lo:900:osp-pre-1-1.0 Request processed in 54us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673073.541050:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789673073.541084:0:17884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb47906300 x1876607738519808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789673089 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673073.541097:0:17884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17884:1876607738519808:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1789673073.542289:0:19759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.542305:0:17127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001235aff5/0x6c78c4f8c9966613 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.542319:0:17127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47476800 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789673073.542323:0:17127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001235aff5/0x6c78c4f8c9966613 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.542333:0:17127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001235aff5/0x6c78c4f8c9966613 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.542352:0:17127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001235aff5/0x6c78c4f8c9966613 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.542361:0:17127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001235aff5/0x6c78c4f8c9966613 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673073.542389:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.542392:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.542394:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.542399:0:19759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673073.542401:0:19759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789673073.544888:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17165:x1876607738519680:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6131us (6247us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789673073.544899:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789673073.545097:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17165:1876607738519680:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789673073.545116:0:17165:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:2.0:1789673073.732868:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789673074.645394:0:19819:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg150-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789673074.757246:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789673075.528416:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789673075.528448:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738519936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789673075.528537:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673075.528594:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738519936 00000100:00100000:1.0:1789673075.528604:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738519936 00000100:00100000:1.0:1789673075.528692:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789673075.528703:0:18650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738519936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789673075.528738:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789673075.528790:0:18650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738519936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673075.528813:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789673075.528847:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789673075.528970:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738519936:0@lo:13:osp-pre-0-1.0 00000020:00000004:0.0:1789673075.575421:0:19872:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789673075.576216:0:19872:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789673075.780913:0:19759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789673076.547852:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789673076.547879:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738520064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789673076.547879:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738520192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789673076.548298:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673076.551894:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738520064 00000100:00100000:3.0:1789673076.551909:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738520064 00000100:00100000:3.0:1789673076.551993:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789673076.552006:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738520064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789673076.552048:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789673076.552143:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738520064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (3845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673076.552151:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789673076.552209:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738520064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789673076.555345:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673076.560547:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738520192 00000100:00100000:0.0:1789673076.560569:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738520192 00000100:00100000:0.0:1789673076.560639:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789673076.560649:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738520192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789673076.560713:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789673076.560806:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738520192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (5470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673076.560813:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789673076.560999:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738520192:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1789673076.577181:0:19922:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789673076.577501:0:19922:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789673076.804013:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789673076.894002:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673076.898101:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714314496 00000100:00100000:1.0:1789673076.898124:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714314496 00000100:00100000:1.0:1789673076.898204:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 116 00000100:00100000:1.0:1789673076.898215:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4367bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2394:x1876607714314496:12345-192.168.201.50@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789673076.898498:0:17133:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 027bcf1b-b718-4fc6-8a0f-0cff3993e488@192.168.201.50@tcp t0 exp 0000000000000000 cur 554 last 0 00000020:00000080:1.0:1789673076.898542:0:17133:0:(genops.c:1384:class_connect()) connect: client 027bcf1b-b718-4fc6-8a0f-0cff3993e488, cookie 0x6c78c4f8c9966621 00000100:00080000:1.0:1789673076.898764:0:17133:0:(import.c:65:import_set_state_nolock()) ffff8cfb47579800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789673076.898865:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4367bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+5:2394:x1876607714314496:12345-192.168.201.50@tcp:250:mount.lustre.0 Request processed in 650us (4875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673076.898874:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 116 00000100:00100000:3.0:1789673076.913418:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673076.913514:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714314624 00000100:00100000:1.0:1789673076.913526:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714314624 00000100:00100000:1.0:1789673076.913638:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 117 00000100:00100000:1.0:1789673076.913649:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4367ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+5:14898:x1876607714314624:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789673076.913708:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789673076.913729:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966628 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd253bc expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673076.913760:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253bc expref: 6 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673076.913790:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb482e4e00/0x6c78c4f8c9966628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253bc expref: 6 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673076.913800:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e4e00, rc 0) 00000100:00100000:1.0:1789673076.913869:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4367ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+6:14898:x1876607714314624:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 221us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673076.913878:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 117 00000100:00100000:0.0:1789673076.928992:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673076.938059:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714314752 00000100:00100000:3.0:1789673076.938076:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714314752 00000100:00100000:3.0:1789673076.938183:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 118 00000100:00100000:3.0:1789673076.938196:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+6:14898:x1876607714314752:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789673076.938386:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+6:14898:x1876607714314752:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 192us (9402us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789673076.938395:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 118 00000100:00100000:2.0:1789673076.944567:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673076.944735:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714314880 00000100:00100000:1.0:1789673076.944745:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714314880 00000100:00100000:1.0:1789673076.944813:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 119 00000100:00100000:1.0:1789673076.944824:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+6:14898:x1876607714314880:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789673076.944842:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789673076.944865:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb482e4400/0x6c78c4f8c996662f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd253c3 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673076.944900:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb482e4400/0x6c78c4f8c996662f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253c3 expref: 7 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673076.944950:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb482e4400/0x6c78c4f8c996662f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253c3 expref: 7 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673076.944962:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e4400, rc 0) 00000100:00100000:1.0:1789673076.945038:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+7:14898:x1876607714314880:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 215us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673076.945046:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 119 00000100:00100000:0.0:1789673076.957234:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673076.957718:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714315008 00000100:00100000:1.0:1789673076.957747:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714315008 00000100:00100000:1.0:1789673076.957815:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00100000:1.0:1789673076.957826:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+7:14898:x1876607714315008:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789673076.958033:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+8:14898:x1876607714315008:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 208us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673076.958040:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 120 00000100:00100000:0.0:1789673076.965319:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673076.965591:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714315136 00000100:00100000:3.0:1789673076.965602:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714315136 00000100:00100000:3.0:1789673076.965706:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 121 00000100:00100000:3.0:1789673076.965718:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+8:14898:x1876607714315136:12345-192.168.201.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789673076.965889:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+8:14898:x1876607714315136:12345-192.168.201.50@tcp:503:mount.lustre.0 Request processed in 173us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673076.965900:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 121 00000100:00100000:3.0:1789673076.987891:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673076.988086:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714315264 00000100:00100000:2.0:1789673076.988097:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714315264 00000100:00100000:2.0:1789673076.988169:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 122 00000100:00100000:2.0:1789673076.988181:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+8:14916:x1876607714315264:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789673076.988423:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+8:14916:x1876607714315264:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 244us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673076.988434:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 122 00000100:00100000:0.0:1789673077.037451:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673077.039005:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714315392 00000100:00100000:1.0:1789673077.039017:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714315392 00000100:00100000:1.0:1789673077.039099:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 123 00000100:00100000:1.0:1789673077.039110:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+8:14916:x1876607714315392:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789673077.039322:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+8:14916:x1876607714315392:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 214us (1882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673077.039330:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 123 00000100:00100000:0.0:1789673077.045779:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673077.045900:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714315520 00000100:00100000:3.0:1789673077.045922:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714315520 00000100:00100000:3.0:1789673077.045985:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 124 00000100:00100000:3.0:1789673077.045995:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+8:14916:x1876607714315520:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789673077.046180:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+8:14916:x1876607714315520:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 186us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673077.046200:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 124 00000100:00100000:3.0:1789673077.049826:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673077.050000:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714315648 00000100:00100000:2.0:1789673077.050012:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714315648 00000100:00100000:2.0:1789673077.050083:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 125 00000100:00100000:2.0:1789673077.050095:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+8:14898:x1876607714315648:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789673077.050111:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673077.050130:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c9966636 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd253f4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673077.050158:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c9966636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253f4 expref: 9 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673077.050170:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb46aefa00/0x6c78c4f8c9966636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253f4 expref: 9 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673077.050179:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aefa00, rc 0) 00000100:00100000:2.0:1789673077.050879:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+9:14898:x1876607714315648:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 784us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673077.050906:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 125 00000100:00100000:0.0:1789673077.055130:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673077.055800:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714315776 00000100:00100000:1.0:1789673077.055812:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714315776 00000100:00100000:1.0:1789673077.055880:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 126 00000100:00100000:1.0:1789673077.055890:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+9:14898:x1876607714315776:12345-192.168.201.50@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789673077.055929:0:17133:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789673077.055959:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789673077.055964:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789673077.055968:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789673077.055971:0:17133:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789673077.055973:0:17133:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789673077.057824:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+9:14898:x1876607714315776:12345-192.168.201.50@tcp:256:mount.lustre.0 Request processed in 1926us (2694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673077.057837:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 126 00000100:00100000:3.0:1789673077.061743:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673077.062533:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714315904 00000100:00100000:1.0:1789673077.062545:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714315904 00000100:00100000:0.0:1789673077.062784:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 127 00000100:00100000:0.0:1789673077.062795:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+9:14898:x1876607714315904:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789673077.062833:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673077.062868:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996663d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd253fb expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673077.062898:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996663d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253fb expref: 10 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673077.062920:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996663d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253fb expref: 10 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673077.062929:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cc200, rc 0) 00000100:00100000:0.0:1789673077.063000:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+10:14898:x1876607714315904:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 207us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673077.063007:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 127 00000100:00100000:0.0:1789673077.065347:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673077.065429:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714316032 00000100:00100000:1.0:1789673077.065439:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714316032 00000100:00100000:1.0:1789673077.065495:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 128 00000100:00100000:1.0:1789673077.065505:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+10:14898:x1876607714316032:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789673077.065695:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+10:14898:x1876607714316032:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 192us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673077.065703:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 128 00000100:00100000:3.0:1789673077.068119:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673077.068458:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714316160 00000100:00100000:0.0:1789673077.068468:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714316160 00000100:00100000:0.0:1789673077.068526:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 129 00000100:00100000:0.0:1789673077.068536:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+10:14898:x1876607714316160:12345-192.168.201.50@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789673077.068732:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+10:14898:x1876607714316160:12345-192.168.201.50@tcp:503:mount.lustre.0 Request processed in 196us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673077.068741:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 129 00000100:00100000:3.0:1789673077.072334:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673077.072536:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714316288 00000100:00100000:2.0:1789673077.072548:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714316288 00000100:00100000:2.0:1789673077.072617:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 130 00000100:00100000:2.0:1789673077.072628:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+10:14921:x1876607714316288:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789673077.072838:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+10:14921:x1876607714316288:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 211us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673077.072847:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 130 00000100:00100000:2.0:1789673077.089300:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673077.089382:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714316416 00000100:00100000:1.0:1789673077.089392:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714316416 00000100:00100000:1.0:1789673077.089454:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 131 00000100:00100000:1.0:1789673077.089466:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+10:14921:x1876607714316416:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789673077.089698:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+10:14921:x1876607714316416:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 193us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673077.089707:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 131 00000100:00100000:3.0:1789673077.105882:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673077.105976:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714316544 00000100:00100000:1.0:1789673077.105988:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714316544 00000100:00100000:3.0:1789673077.106008:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673077.106591:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714316800 00000100:00100000:2.0:1789673077.106598:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714316800 00000100:00100000:1.0:1789673077.106647:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:1.0:1789673077.106680:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7c407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1876607714316544:12345-192.168.201.50@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789673077.106716:0:17139:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 10bccd63-9b9d-4821-aed0-aaa14fbada75@192.168.201.50@tcp t0 exp 0000000000000000 cur 555 last 0 00000100:00100000:2.0:1789673077.106784:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:2.0:1789673077.106791:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1876607714316800:12345-192.168.201.50@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789673077.106814:0:17138:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 10bccd63-9b9d-4821-aed0-aaa14fbada75@192.168.201.50@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:0.0:1789673077.106885:0:17139:0:(genops.c:1384:class_connect()) connect: client 10bccd63-9b9d-4821-aed0-aaa14fbada75, cookie 0x6c78c4f8c996664b 00000004:00100000:0.0:1789673077.106919:0:17139:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:00000080:2.0:1789673077.106931:0:17138:0:(genops.c:1384:class_connect()) connect: client 10bccd63-9b9d-4821-aed0-aaa14fbada75, cookie 0x6c78c4f8c9966644 00000004:00100000:2.0:1789673077.106947:0:17138:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789673077.107282:0:17138:0:(import.c:65:import_set_state_nolock()) ffff8cfb45ba4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789673077.107359:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:2394:x1876607714316800:12345-192.168.201.50@tcp:38:mount.lustre.0 Request processed in 566us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673077.107367:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00080000:0.0:1789673077.108417:0:17139:0:(import.c:65:import_set_state_nolock()) ffff8cfb41992000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789673077.108479:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7c407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:2394:x1876607714316544:12345-192.168.201.50@tcp:38:mount.lustre.0 Request processed in 1822us (2606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673077.108506:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:3.0:1789673077.114561:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673077.114616:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673077.114726:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714316928 00000100:00100000:1.0:1789673077.114738:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714316928 00000100:00100000:2.0:1789673077.114741:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714316672 00000100:00100000:2.0:1789673077.114748:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714316672 00000100:00080000:3.0:1789673077.114828:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789673077.114834:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789673077.114842:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:2.0:1789673077.114991:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:0:x1876607714316672:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789673077.115030:0:17138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789673077.115185:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:0:x1876607714316672:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 198us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673077.115203:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:2.0:1789673077.118573:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:2.0:1789673077.118596:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:0:x1876607714316928:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789673077.118643:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789673077.118829:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:0:x1876607714316928:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 241us (4277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673077.118837:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:3.0:1789673077.119022:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673077.119206:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714317056 00000100:00100000:3.0:1789673077.119214:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714317056 00000100:00100000:1.0:1789673077.119570:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:1.0:1789673077.119581:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:14898:x1876607714317056:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789673077.119600:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789673077.119695:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:14898:x1876607714317056:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 117us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673077.119702:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:0.0:1789673077.123637:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673077.123808:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714317184 00000100:00100000:2.0:1789673077.123818:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714317184 00000100:00100000:2.0:1789673077.123994:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:2.0:1789673077.124007:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:14898:x1876607714317184:12345-192.168.201.50@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789673077.124116:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:14898:x1876607714317184:12345-192.168.201.50@tcp:40:mount.lustre.0 Request processed in 112us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673077.124123:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:2.0:1789673077.126805:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673077.127380:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673077.127761:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714317568 00000100:00100000:1.0:1789673077.127773:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714317568 00000100:00100000:1.0:1789673077.127894:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:1.0:1789673077.127906:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:14898:x1876607714317568:12345-192.168.201.50@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789673077.128006:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:14898:x1876607714317568:12345-192.168.201.50@tcp:900:mount.lustre.0 Request processed in 102us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673077.128014:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:3.0:1789673077.128537:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714317312 00000100:00100000:3.0:1789673077.128545:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714317312 00000100:00100000:3.0:1789673077.128619:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:3.0:1789673077.128626:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1876607714317312:12345-192.168.201.50@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789673077.128676:0:18647:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 10bccd63-9b9d-4821-aed0-aaa14fbada75@192.168.201.50@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:3.0:1789673077.128717:0:18647:0:(genops.c:1384:class_connect()) connect: client 10bccd63-9b9d-4821-aed0-aaa14fbada75, cookie 0x6c78c4f8c9966652 00002000:00100000:3.0:1789673077.128729:0:18647:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 10bccd63-9b9d-4821-aed0-aaa14fbada75/ffff8cfb468c1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789673077.128750:0:18647:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789673077.128994:0:18647:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1789673077.129003:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00080000:3.0:1789673077.129035:0:18647:0:(import.c:65:import_set_state_nolock()) ffff8cfb468c1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789673077.129088:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:2394:x1876607714317312:12345-192.168.201.50@tcp:8:mount.lustre.0 Request processed in 460us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673077.129096:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:3.0:1789673077.136770:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714317440 00000100:00100000:3.0:1789673077.137447:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714317440 00000100:00100000:3.0:1789673077.137514:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:3.0:1789673077.137524:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1876607714317440:12345-192.168.201.50@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789673077.137568:0:18647:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 10bccd63-9b9d-4821-aed0-aaa14fbada75@192.168.201.50@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:3.0:1789673077.137614:0:18647:0:(genops.c:1384:class_connect()) connect: client 10bccd63-9b9d-4821-aed0-aaa14fbada75, cookie 0x6c78c4f8c9966659 00002000:00100000:3.0:1789673077.137642:0:18647:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 10bccd63-9b9d-4821-aed0-aaa14fbada75/ffff8cfb468c6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789673077.137706:0:18647:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789673077.137921:0:18647:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789673077.137960:0:18647:0:(import.c:65:import_set_state_nolock()) ffff8cfb47549800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789673077.138592:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:2394:x1876607714317440:12345-192.168.201.50@tcp:8:mount.lustre.0 Request processed in 1065us (9588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673077.138602:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:0.0:1789673077.138769:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673077.139635:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714317696 00000100:00100000:3.0:1789673077.139646:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714317696 00000100:00100000:3.0:1789673077.139711:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:3.0:1789673077.139721:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:14898:x1876607714317696:12345-192.168.201.50@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789673077.143787:0:17141:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3951us 00000004:00200000:3.0:1789673077.160036:0:17141:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789673077.160327:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:14898:x1876607714317696:12345-192.168.201.50@tcp:33:mount.lustre.0 Request processed in 20600us (21551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673077.160339:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:0.0:1789673077.324964:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673077.325099:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714317824 00000100:00100000:3.0:1789673077.325110:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714317824 00000100:00100000:3.0:1789673077.325202:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:3.0:1789673077.325214:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:14944:x1876607714317824:12345-192.168.201.50@tcp:101:mkdir.0 00010000:00010000:3.0:1789673077.325237:0:19758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673077.325265:0:19758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477000/0x6c78c4f8c9966660 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2542c expref: -99 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673077.325335:0:19758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c9966667 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673077.325369:0:19758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c9966667 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673077.325388:0:19758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c9966667 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789673077.325443:0:19758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789673077.325447:0:19758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789673077.325488:0:19758:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c9966667 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673077.325519:0:19758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477000/0x6c78c4f8c9966660 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2542c expref: 8 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673077.325539:0:19758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c9966667 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2542c expref: 7 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673077.325547:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc462d0f00) 00010000:00010000:3.0:1789673077.325550:0:19758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789673077.325554:0:19758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb47476600, rc 0) 00000100:00100000:3.0:1789673077.325630:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+7:14944:x1876607714317824:12345-192.168.201.50@tcp:101:mkdir.0 Request processed in 418us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673077.325637:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00000040:00080000:0.0:1789673077.509011:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789673077.571940:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738520320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789673077.572020:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673077.572488:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738520320 00000100:00100000:3.0:1789673077.572497:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738520320 00000100:00080000:2.0:1789673077.572619:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789673077.572685:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789673077.572697:0:18650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738520320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789673077.572747:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789673077.572984:0:18650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738520320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 290us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673077.572992:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789673077.573258:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738520320:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789673077.828625:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789673078.596761:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738520448:0@lo:400:kworker.0 00000100:00100000:3.0:1789673078.596841:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673078.596899:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738520960:0@lo:400:kworker.0 00000100:00100000:3.0:1789673078.596929:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673078.596950:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738521472:0@lo:400:kworker.0 00000100:00100000:3.0:1789673078.596972:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673078.596988:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738521984:0@lo:400:kworker.0 00000100:00100000:3.0:1789673078.597017:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673078.597056:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789673078.597062:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738520576:0@lo:400:kworker.0 00000100:00100000:3.0:1789673078.597085:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673078.597100:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738521088:0@lo:400:kworker.0 00000100:00100000:3.0:1789673078.597120:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673078.597144:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738521600:0@lo:400:kworker.0 00000100:00100000:3.0:1789673078.597163:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673078.597195:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738520960 00000100:00100000:3.0:1789673078.597202:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738520960 00000100:00100000:3.0:1789673078.597242:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738521472 00000100:00100000:3.0:1789673078.597362:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738521472 00000100:00100000:3.0:1789673078.597383:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738521984 00000100:00100000:3.0:1789673078.597385:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738521984 00000100:00100000:3.0:1789673078.597405:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738521600 00000100:00100000:3.0:1789673078.597407:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738521600 00000100:00100000:3.0:1789673078.597439:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789673078.597446:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738520960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673078.597498:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876607738520960:12345-0@lo:400:kworker.0 Request processed in 52us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673078.597504:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789673078.597521:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789673078.597526:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738521472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673078.597551:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738521472:12345-0@lo:400:kworker.0 Request processed in 25us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673078.597556:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789673078.597565:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789673078.597571:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738521984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673078.597594:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738521984:12345-0@lo:400:kworker.0 Request processed in 24us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673078.597701:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738520832:0@lo:400:kworker.0 00000100:00100000:1.0:1789673078.597733:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673078.597752:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738521344:0@lo:400:kworker.0 00000100:00100000:1.0:1789673078.597770:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673078.597783:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876607738521856:0@lo:400:kworker.0 00000100:00100000:1.0:1789673078.597802:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673078.597816:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789673078.597822:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738520704:0@lo:400:kworker.0 00000100:00100000:1.0:1789673078.597842:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673078.597860:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738521216:0@lo:400:kworker.0 00000100:00100000:1.0:1789673078.597880:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673078.597918:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738521728:0@lo:400:kworker.0 00000100:00100000:1.0:1789673078.597941:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673078.597965:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738521856 00000100:00100000:1.0:1789673078.597970:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738521856 00000100:00100000:1.0:1789673078.597992:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738521728 00000100:00100000:1.0:1789673078.597995:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738521728 00000100:00100000:1.0:1789673078.598009:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789673078.598016:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738521600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673078.598060:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876607738521600:12345-0@lo:400:kworker.0 Request processed in 44us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673078.598066:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789673078.598078:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789673078.598084:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876607738521856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673078.598112:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d869180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1876607738521856:12345-0@lo:400:kworker.0 Request processed in 29us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673078.598118:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789673078.598130:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789673078.598136:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738521728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673078.598159:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d868380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1876607738521728:12345-0@lo:400:kworker.0 Request processed in 24us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673078.598165:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789673078.598186:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738520832 00000100:00100000:1.0:1789673078.598189:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738520832 00000100:00100000:1.0:1789673078.598210:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738521344 00000100:00100000:1.0:1789673078.598213:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738521344 00000100:00100000:1.0:1789673078.598224:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738520704 00000100:00100000:1.0:1789673078.598226:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738520704 00000100:00100000:1.0:1789673078.598235:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738521216 00000100:00100000:1.0:1789673078.598243:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738521216 00000100:00100000:0.0:1789673078.598643:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738520576 00000100:00100000:0.0:1789673078.598648:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738520576 00000100:00100000:0.0:1789673078.598694:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738521088 00000100:00100000:0.0:1789673078.598698:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738521088 00000100:00100000:0.0:1789673078.598714:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789673078.598721:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738520576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673078.598762:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738520576:12345-0@lo:400:kworker.0 Request processed in 41us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673078.598768:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789673078.598780:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789673078.598786:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738521088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673078.598811:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738521088:12345-0@lo:400:kworker.0 Request processed in 26us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673078.598817:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789673078.598838:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738520448 00000100:00100000:0.0:1789673078.598842:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738520448 00000100:00100000:0.0:1789673078.598866:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789673078.598872:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:3637:x1876607738520448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673078.598917:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:3637:x1876607738520448:12345-0@lo:400:kworker.0 Request processed in 45us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673078.598934:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00080000:0.0:1789673078.599022:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8df480 x1876607738521728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789673078.599049:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1876607738521728:0@lo:400:kworker.0 00000100:00100000:0.0:1789673078.599070:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1876607738521856:0@lo:400:kworker.0 00000100:00100000:0.0:1789673078.599113:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738520576:0@lo:400:kworker.0 00000100:00100000:0.0:1789673078.599124:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738521088:0@lo:400:kworker.0 00000100:00100000:0.0:1789673078.599152:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1876607738521600:0@lo:400:kworker.0 00000100:00100000:0.0:1789673078.599162:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3637:1876607738520448:0@lo:400:kworker.0 00000100:00100000:0.0:1789673078.599174:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876607738520960:0@lo:400:kworker.0 00000100:00100000:0.0:1789673078.599186:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738521472:0@lo:400:kworker.0 00010000:00080000:0.0:1789673078.599200:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7d8ded80 x1876607738521984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789673078.599210:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738521984:0@lo:400:kworker.0 00000100:00100000:0.0:1789673078.599237:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789673078.599256:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738522112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789673078.599284:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673078.599314:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738522112 00000100:00100000:0.0:1789673078.599318:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738522112 00000100:00100000:0.0:1789673078.599345:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789673078.599352:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1876607738522112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789673078.599376:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789673078.599413:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1876607738522112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673078.599420:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789673078.599450:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738522112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789673078.599479:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789673078.599488:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1876607738520832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673078.599523:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1876607738520832:12345-0@lo:400:kworker.0 Request processed in 37us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673078.599529:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789673078.599544:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789673078.599550:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738521344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673078.599577:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738521344:12345-0@lo:400:kworker.0 Request processed in 28us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673078.599583:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789673078.599594:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789673078.599601:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738520704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673078.599629:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738520704:12345-0@lo:400:kworker.0 Request processed in 30us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673078.599634:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789673078.599687:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738520704:0@lo:400:kworker.0 00000100:00100000:0.0:1789673078.599700:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738520832:0@lo:400:kworker.0 00000100:00100000:0.0:1789673078.599711:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738521344:0@lo:400:kworker.0 00000100:00100000:3.0:1789673078.600052:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789673078.601991:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789673078.602005:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738521216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673078.602128:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d869f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738521216:12345-0@lo:400:kworker.0 Request processed in 127us (4245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673078.602353:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738522240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789673078.602397:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789673078.602440:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789673078.602445:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789673078.602448:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789673078.602452:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789673078.602465:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738522240 00000100:00100000:2.0:1789673078.602487:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738522240 00000100:00100000:2.0:1789673078.602521:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789673078.602528:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738522240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789673078.602544:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789673078.602583:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738522240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673078.602591:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789673078.602635:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738522240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789673078.603278:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738521216:0@lo:400:kworker.0 00000100:00100000:1.0:1789673078.603374:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789673078.852940:0:19759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789673079.116966:0:19462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10bccd63-9b9d-4821-aed0-aaa14fbada75 00000001:00080000:1.0:1789673079.116988:0:19462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1789673079.291588:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673079.291822:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714317952 00000100:00100000:1.0:1789673079.291833:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714317952 00000100:00100000:1.0:1789673079.291956:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:1.0:1789673079.291967:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+7:14997:x1876607714317952:12345-192.168.201.50@tcp:41:lfs.0 00000100:00080000:2.0:1789673079.292156:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1789673079.292365:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789673079.292500:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+7:14997:x1876607714317952:12345-192.168.201.50@tcp:41:lfs.0 Request processed in 534us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673079.292509:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:0.0:1789673079.297702:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673079.297825:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714318080 00000100:00100000:2.0:1789673079.297836:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714318080 00000100:00100000:2.0:1789673079.297933:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:2.0:1789673079.297944:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:14997:x1876607714318080:12345-192.168.201.50@tcp:41:lfs.0 00000004:00000024:2.0:1789673079.297984:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:0.0:1789673079.298614:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789673079.298764:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:14997:x1876607714318080:12345-192.168.201.50@tcp:41:lfs.0 Request processed in 821us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673079.298772:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00000040:00080000:1.0:1789673079.303332:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789673079.305639:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673079.306158:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714318208 00000100:00100000:2.0:1789673079.306171:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714318208 00000100:00100000:2.0:1789673079.306311:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:2.0:1789673079.306323:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:14997:x1876607714318208:12345-192.168.201.50@tcp:13:lfs.0 00002000:00000024:2.0:1789673079.306366:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789673079.306476:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:14997:x1876607714318208:12345-192.168.201.50@tcp:13:lfs.0 Request processed in 155us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673079.306484:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00080000:0.0:1789673079.309058:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789673079.310104:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673079.310540:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714318336 00000100:00100000:2.0:1789673079.310567:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714318336 00000100:00100000:2.0:1789673079.310647:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:2.0:1789673079.310685:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:14997:x1876607714318336:12345-192.168.201.50@tcp:13:lfs.0 00002000:00000024:2.0:1789673079.310725:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789673079.310966:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:14997:x1876607714318336:12345-192.168.201.50@tcp:13:lfs.0 Request processed in 309us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673079.310975:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00080000:0.0:1789673079.313960:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789673079.445469:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673079.445572:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714318464 00000100:00100000:3.0:1789673079.445582:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714318464 00000100:00100000:3.0:1789673079.445634:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 133 00000100:00100000:3.0:1789673079.445642:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+10:15025:x1876607714318464:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789673079.445682:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673079.445700:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb47477000/0x6c78c4f8c996666e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25433 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673079.445726:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb47477000/0x6c78c4f8c996666e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25433 expref: 11 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673079.445752:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb47477000/0x6c78c4f8c996666e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25433 expref: 11 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673079.445760:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb47477000, rc 0) 00000100:00100000:3.0:1789673079.445828:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+11:15025:x1876607714318464:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 186us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673079.445835:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 133 00000100:00100000:1.0:1789673079.451141:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673079.457148:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714318592 00000100:00100000:2.0:1789673079.457163:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714318592 00000100:00100000:2.0:1789673079.457251:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 134 00000100:00100000:2.0:1789673079.457264:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+11:15025:x1876607714318592:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789673079.457464:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+11:15025:x1876607714318592:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 203us (6337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673079.457470:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 134 00000100:00100000:1.0:1789673079.460898:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673079.461217:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714318720 00000100:00100000:0.0:1789673079.461231:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714318720 00000100:00100000:0.0:1789673079.461295:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 135 00000100:00100000:0.0:1789673079.461306:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+11:15025:x1876607714318720:12345-192.168.201.50@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789673079.461484:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+11:15025:x1876607714318720:12345-192.168.201.50@tcp:503:mount.lustre.0 Request processed in 179us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673079.461493:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 135 00000100:00100000:1.0:1789673079.464848:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673079.465080:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714318848 00000100:00100000:3.0:1789673079.465093:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714318848 00000100:00100000:3.0:1789673079.465164:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 136 00000100:00100000:3.0:1789673079.465175:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+11:15033:x1876607714318848:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789673079.465369:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+11:15033:x1876607714318848:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 194us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673079.465377:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 136 00000100:00100000:1.0:1789673079.496388:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673079.496623:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714318976 00000100:00100000:2.0:1789673079.496635:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714318976 00000100:00100000:2.0:1789673079.496751:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 137 00000100:00100000:2.0:1789673079.496763:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+11:15033:x1876607714318976:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789673079.497905:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+11:15033:x1876607714318976:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 1048us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673079.497921:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 137 00000100:00100000:1.0:1789673079.506278:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673079.506505:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714319104 00000100:00100000:0.0:1789673079.506516:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714319104 00000100:00100000:0.0:1789673079.506583:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 138 00000100:00100000:0.0:1789673079.506596:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+11:15033:x1876607714319104:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789673079.508954:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+11:15033:x1876607714319104:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 219us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673079.508977:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 138 00000100:00100000:1.0:1789673079.524976:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673079.525690:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714319232 00000100:00100000:2.0:1789673079.525701:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714319232 00000100:00100000:2.0:1789673079.525760:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 139 00000100:00100000:2.0:1789673079.525769:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d97f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+11:15025:x1876607714319232:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789673079.525805:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673079.525824:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb46aef600/0x6c78c4f8c9966675 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25464 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673079.525856:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb46aef600/0x6c78c4f8c9966675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25464 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673079.525879:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb46aef600/0x6c78c4f8c9966675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25464 expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673079.526078:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aef600, rc 0) 00000100:00100000:2.0:1789673079.526159:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d97f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+12:15025:x1876607714319232:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 388us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673079.526166:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 139 00000100:00100000:1.0:1789673079.530702:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673079.530951:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714319360 00000100:00100000:0.0:1789673079.530971:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714319360 00000100:00100000:0.0:1789673079.531046:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 140 00000100:00100000:0.0:1789673079.531057:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+12:15025:x1876607714319360:12345-192.168.201.50@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789673079.531106:0:17132:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789673079.531124:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789673079.531128:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789673079.531131:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789673079.531134:0:17132:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789673079.531136:0:17132:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789673079.533727:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+12:15025:x1876607714319360:12345-192.168.201.50@tcp:256:mount.lustre.0 Request processed in 2661us (3071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673079.533741:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 140 00000100:00100000:1.0:1789673079.545227:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673079.545317:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714319488 00000100:00100000:2.0:1789673079.545327:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714319488 00000100:00100000:2.0:1789673079.545391:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 141 00000100:00100000:2.0:1789673079.545402:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+12:15025:x1876607714319488:12345-192.168.201.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789673079.545421:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673079.545441:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb46aee200/0x6c78c4f8c996667c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2546b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673079.545473:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb46aee200/0x6c78c4f8c996667c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2546b expref: 13 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673079.545485:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb46aee200/0x6c78c4f8c996667c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2546b expref: 13 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673079.545515:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb46aee200, rc 0) 00000100:00100000:2.0:1789673079.545581:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:15025:x1876607714319488:12345-192.168.201.50@tcp:101:mount.lustre.0 Request processed in 180us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673079.545588:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 141 00000100:00100000:1.0:1789673079.547333:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673079.548185:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714319616 00000100:00100000:0.0:1789673079.548292:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714319616 00000100:00100000:0.0:1789673079.548419:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 142 00000100:00100000:0.0:1789673079.548431:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:15025:x1876607714319616:12345-192.168.201.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789673079.548777:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:15025:x1876607714319616:12345-192.168.201.50@tcp:501:mount.lustre.0 Request processed in 348us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673079.548785:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 142 00000100:00100000:1.0:1789673079.551095:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673079.551362:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714319744 00000100:00100000:3.0:1789673079.551372:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714319744 00000100:00100000:3.0:1789673079.551432:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 143 00000100:00100000:3.0:1789673079.551442:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:15025:x1876607714319744:12345-192.168.201.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789673079.551605:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:15025:x1876607714319744:12345-192.168.201.50@tcp:503:mount.lustre.0 Request processed in 162us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673079.551613:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 143 00000100:00100000:1.0:1789673079.559123:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673079.560452:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714319872 00000100:00100000:0.0:1789673079.560463:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714319872 00000100:00100000:0.0:1789673079.560731:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 144 00000100:00100000:0.0:1789673079.560751:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:15042:x1876607714319872:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789673079.560946:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:15042:x1876607714319872:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 205us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673079.560954:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 144 00000100:00100000:1.0:1789673079.568785:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673079.571330:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714320000 00000100:00100000:3.0:1789673079.571346:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714320000 00000100:00100000:3.0:1789673079.571427:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 145 00000100:00100000:3.0:1789673079.571438:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:15042:x1876607714320000:12345-192.168.201.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789673079.571639:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:15042:x1876607714320000:12345-192.168.201.50@tcp:502:llog_process_th.0 Request processed in 202us (2863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673079.571647:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 145 00000100:00100000:1.0:1789673079.582568:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673079.582630:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673079.582806:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714320128 00000100:00100000:3.0:1789673079.582831:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714320128 00000100:00100000:3.0:1789673079.582882:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714320384 00000100:00100000:3.0:1789673079.582886:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714320384 00000100:00100000:3.0:1789673079.582916:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:3.0:1789673079.582926:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d86b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1876607714320128:12345-192.168.201.50@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789673079.582960:0:19758:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 163c450b-674a-4081-bea4-a5f6f08422e7@192.168.201.50@tcp t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:3.0:1789673079.583003:0:19758:0:(genops.c:1384:class_connect()) connect: client 163c450b-674a-4081-bea4-a5f6f08422e7, cookie 0x6c78c4f8c9966683 00000004:00100000:3.0:1789673079.583041:0:19758:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789673079.583148:0:19758:0:(import.c:65:import_set_state_nolock()) ffff8cfc7ba5c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789673079.583233:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d86b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:163c450b-674a-4081-bea4-a5f6f08422e7+6:2394:x1876607714320128:12345-192.168.201.50@tcp:38:mount.lustre.0 Request processed in 306us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673079.583242:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:3.0:1789673079.583262:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:3.0:1789673079.583266:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1876607714320384:12345-192.168.201.50@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789673079.583283:0:19758:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 163c450b-674a-4081-bea4-a5f6f08422e7@192.168.201.50@tcp t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:3.0:1789673079.583311:0:19758:0:(genops.c:1384:class_connect()) connect: client 163c450b-674a-4081-bea4-a5f6f08422e7, cookie 0x6c78c4f8c996668a 00000004:00100000:3.0:1789673079.583325:0:19758:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789673079.583377:0:19758:0:(import.c:65:import_set_state_nolock()) ffff8cfc7ba5d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789673079.583404:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d868a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:163c450b-674a-4081-bea4-a5f6f08422e7+6:2394:x1876607714320384:12345-192.168.201.50@tcp:38:mount.lustre.0 Request processed in 135us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673079.583411:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:1.0:1789673079.614991:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673079.615156:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673079.618288:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673079.624380:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714320512 00000100:00100000:2.0:1789673079.624396:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714320512 00000100:00100000:2.0:1789673079.624550:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714320256 00000100:00100000:2.0:1789673079.624555:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714320256 00000100:00100000:2.0:1789673079.624576:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714320640 00000100:00100000:2.0:1789673079.624579:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714320640 00000100:00100000:2.0:1789673079.624600:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:2.0:1789673079.624610:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:163c450b-674a-4081-bea4-a5f6f08422e7+6:0:x1876607714320512:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789673079.624643:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789673079.624738:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:163c450b-674a-4081-bea4-a5f6f08422e7+6:0:x1876607714320512:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 129us (9757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673079.624745:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:2.0:1789673079.624765:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:2.0:1789673079.624772:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:163c450b-674a-4081-bea4-a5f6f08422e7+7:0:x1876607714320256:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789673079.624785:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789673079.624814:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:163c450b-674a-4081-bea4-a5f6f08422e7+7:0:x1876607714320256:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 43us (9659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673079.624821:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:2.0:1789673079.624834:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:2.0:1789673079.624840:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:163c450b-674a-4081-bea4-a5f6f08422e7+6:15025:x1876607714320640:12345-192.168.201.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789673079.624878:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789673079.624902:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:163c450b-674a-4081-bea4-a5f6f08422e7+6:15025:x1876607714320640:12345-192.168.201.50@tcp:41:mount.lustre.0 Request processed in 62us (6626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673079.624910:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00080000:1.0:1789673079.625165:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789673079.625170:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789673079.628442:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673079.628731:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714320768 00000100:00100000:2.0:1789673079.628740:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714320768 00000100:00100000:2.0:1789673079.628845:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:2.0:1789673079.628856:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:163c450b-674a-4081-bea4-a5f6f08422e7+6:15025:x1876607714320768:12345-192.168.201.50@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789673079.629378:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:163c450b-674a-4081-bea4-a5f6f08422e7+6:15025:x1876607714320768:12345-192.168.201.50@tcp:40:mount.lustre.0 Request processed in 523us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673079.629387:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:1.0:1789673079.632483:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673079.632531:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673079.632565:0:19053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714320896 00000100:00100000:1.0:1789673079.632575:0:19053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714320896 00000100:00100000:1.0:1789673079.632620:0:19053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:1.0:1789673079.632629:0:19053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1876607714320896:12345-192.168.201.50@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789673079.632697:0:19053:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 163c450b-674a-4081-bea4-a5f6f08422e7@192.168.201.50@tcp t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:1.0:1789673079.632734:0:19053:0:(genops.c:1384:class_connect()) connect: client 163c450b-674a-4081-bea4-a5f6f08422e7, cookie 0x6c78c4f8c9966691 00002000:00100000:1.0:1789673079.632746:0:19053:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 163c450b-674a-4081-bea4-a5f6f08422e7/ffff8cfc44208000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789673079.632762:0:19053:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789673079.632887:0:19053:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789673079.632919:0:19053:0:(import.c:65:import_set_state_nolock()) ffff8cfc4420f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789673079.633026:0:19053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:163c450b-674a-4081-bea4-a5f6f08422e7+6:2394:x1876607714320896:12345-192.168.201.50@tcp:8:mount.lustre.0 Request processed in 396us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673079.633035:0:19053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:1.0:1789673079.633085:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673079.633191:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714321024 00000100:00100000:1.0:1789673079.633196:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714321024 00000100:00100000:3.0:1789673079.634001:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714321152 00000100:00100000:3.0:1789673079.634020:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714321152 00000100:00100000:3.0:1789673079.634074:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:3.0:1789673079.634084:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:163c450b-674a-4081-bea4-a5f6f08422e7+6:15025:x1876607714321152:12345-192.168.201.50@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789673079.634139:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:163c450b-674a-4081-bea4-a5f6f08422e7+6:15025:x1876607714321152:12345-192.168.201.50@tcp:900:mount.lustre.0 Request processed in 57us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673079.634146:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:1.0:1789673079.634455:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:1.0:1789673079.634461:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2394:x1876607714321024:12345-192.168.201.50@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789673079.636334:0:18648:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 163c450b-674a-4081-bea4-a5f6f08422e7@192.168.201.50@tcp t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:1.0:1789673079.636373:0:18648:0:(genops.c:1384:class_connect()) connect: client 163c450b-674a-4081-bea4-a5f6f08422e7, cookie 0x6c78c4f8c9966698 00002000:00100000:1.0:1789673079.636384:0:18648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 163c450b-674a-4081-bea4-a5f6f08422e7/ffff8cfc7f516000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789673079.636395:0:18648:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789673079.636636:0:18648:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789673079.636692:0:18648:0:(import.c:65:import_set_state_nolock()) ffff8cfc7f510800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789673079.636829:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:163c450b-674a-4081-bea4-a5f6f08422e7+6:2394:x1876607714321024:12345-192.168.201.50@tcp:8:mount.lustre.0 Request processed in 2365us (3742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673079.636841:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:3.0:1789673079.645582:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673079.645878:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714321280 00000100:00100000:2.0:1789673079.645889:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714321280 00000100:00100000:2.0:1789673079.645941:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:2.0:1789673079.645951:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:163c450b-674a-4081-bea4-a5f6f08422e7+6:15025:x1876607714321280:12345-192.168.201.50@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789673079.646154:0:17142:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789673079.646477:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:163c450b-674a-4081-bea4-a5f6f08422e7+6:15025:x1876607714321280:12345-192.168.201.50@tcp:33:mount.lustre.0 Request processed in 526us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673079.646486:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:0.0:1789673079.819101:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673079.819247:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714321408 00000100:00100000:3.0:1789673079.819259:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714321408 00000100:00100000:3.0:1789673079.819325:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:3.0:1789673079.819335:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:163c450b-674a-4081-bea4-a5f6f08422e7+6:15065:x1876607714321408:12345-192.168.201.50@tcp:101:mkdir.0 00010000:00010000:3.0:1789673079.819355:0:19758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673079.819377:0:19758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476800/0x6c78c4f8c996669f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2549c expref: -99 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673079.819441:0:19758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c99666a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673079.819454:0:19758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c99666a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673079.819469:0:19758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c99666a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789673079.819512:0:19758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789673079.819515:0:19758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789673079.819531:0:19758:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c99666a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673079.819571:0:19758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476800/0x6c78c4f8c996669f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2549c expref: 8 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673079.819584:0:19758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c99666a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2549c expref: 7 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673079.819590:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc462d0f00) 00010000:00010000:3.0:1789673079.819592:0:19758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789673079.819595:0:19758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb47476c00, rc 0) 00000100:00100000:3.0:1789673079.819652:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:163c450b-674a-4081-bea4-a5f6f08422e7+7:15065:x1876607714321408:12345-192.168.201.50@tcp:101:mkdir.0 Request processed in 319us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673079.819721:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00010000:00010000:2.0:1789673079.876120:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789673080.644050:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738522368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789673080.644134:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673080.644559:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738522368 00000100:00100000:1.0:1789673080.644569:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738522368 00000100:00100000:1.0:1789673080.644645:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789673080.644682:0:18650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738522368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789673080.644720:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789673080.644789:0:18650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738522368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673080.644809:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789673080.644872:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738522368:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789673080.646384:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789673080.912536:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673081.667960:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738522496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789673081.668076:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673081.668275:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738522496 00000100:00100000:1.0:1789673081.668284:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738522496 00000100:00100000:1.0:1789673081.668343:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789673081.668353:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738522496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789673081.668400:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789673081.668453:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738522496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673081.668460:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789673081.668615:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738522496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789673081.669059:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789673081.669070:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738522624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789673081.669109:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673081.669138:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738522624 00000100:00100000:2.0:1789673081.669151:0:17882:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738522624 00000100:00100000:2.0:1789673081.669193:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789673081.669201:0:17882:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738522624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789673081.669225:0:17882:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789673081.669275:0:17882:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738522624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673081.669283:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789673081.669310:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738522624:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789673081.924950:0:19759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789673082.424214:0:20019:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789673082.692318:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738522752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789673082.692401:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673082.692495:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738522752 00000100:00100000:1.0:1789673082.692504:0:18650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738522752 00000100:00100000:1.0:1789673082.692587:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789673082.692599:0:18650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738522752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789673082.692637:0:18650:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1789673082.693280:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789673082.694413:0:18650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738522752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1811us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673082.694426:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789673082.694543:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738522752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789673082.948927:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789673083.210058:0:18642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 163c450b-674a-4081-bea4-a5f6f08422e7 00000001:00100000:2.0:1789673083.210076:0:18642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10bccd63-9b9d-4821-aed0-aaa14fbada75 00000001:00100000:2.0:1789673083.210100:0:17872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 163c450b-674a-4081-bea4-a5f6f08422e7 00000001:00100000:2.0:1789673083.210108:0:17872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 10bccd63-9b9d-4821-aed0-aaa14fbada75 00000001:00100000:2.0:1789673083.213779:0:17118:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 163c450b-674a-4081-bea4-a5f6f08422e7 00000001:00100000:2.0:1789673083.213796:0:17118:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 10bccd63-9b9d-4821-aed0-aaa14fbada75 00000100:00100000:0.0:1789673083.715854:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789673083.715882:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738522880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789673083.715956:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673083.716037:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738522880 00000100:00100000:0.0:1789673083.716046:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738522880 00000100:00100000:0.0:1789673083.716106:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789673083.716115:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738522880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789673083.716145:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789673083.716190:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738522880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673083.716197:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789673083.716220:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789673083.716248:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1789673083.716269:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738522880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789673083.723080:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738523136:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723141:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673083.723176:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738523648:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723194:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673083.723212:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738524160:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723236:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673083.723260:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789673083.723266:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3638:1876607738523008:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723294:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673083.723314:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738523520:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723331:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673083.723342:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738524032:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723365:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673083.723389:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738523136 00000100:00100000:1.0:1789673083.723396:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738523136 00000100:00100000:1.0:1789673083.723428:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738523520 00000100:00100000:1.0:1789673083.723430:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738523520 00000100:00100000:1.0:1789673083.723441:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789673083.723447:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738523136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723488:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738523136:12345-0@lo:400:kworker.0 Request processed in 42us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673083.723493:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789673083.723506:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789673083.723509:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738523520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723525:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738523520:12345-0@lo:400:kworker.0 Request processed in 15us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673083.723528:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789673083.723541:0:19053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738523648 00000100:00100000:1.0:1789673083.723544:0:19053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738523648 00000100:00100000:1.0:1789673083.723568:0:19053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789673083.723571:0:19053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738523648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723590:0:19053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738523648:12345-0@lo:400:kworker.0 Request processed in 19us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673083.723594:0:19053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789673083.723608:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738524160 00000100:00100000:1.0:1789673083.723610:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738524160 00000100:00100000:1.0:1789673083.723627:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738524032 00000100:00100000:1.0:1789673083.723628:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738524032 00000100:00100000:1.0:1789673083.723640:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789673083.723644:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738524160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723704:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876607738524160:12345-0@lo:400:kworker.0 Request processed in 60us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673083.723709:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789673083.723717:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789673083.723721:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738524032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723735:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876607738524032:12345-0@lo:400:kworker.0 Request processed in 14us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673083.723738:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789673083.723769:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738523520:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723778:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1876607738524032:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723785:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738523136:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723807:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738523648:0@lo:400:kworker.0 00010000:00080000:1.0:1789673083.723819:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfb4744e680 x1876607738524160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673083.723829:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1876607738524160:0@lo:400:kworker.0 00000100:00080000:1.0:1789673083.723860:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789673083.723862:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789673083.723865:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789673083.723871:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738523264:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723889:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673083.723902:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738523776:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723913:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673083.723922:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738524288:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723947:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673083.723965:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789673083.723971:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738523392:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.723990:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673083.724005:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb4744d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738523904:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.724019:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673083.724029:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738524416:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.724039:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673083.724053:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738523264 00000100:00100000:1.0:1789673083.724056:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738523264 00000100:00100000:1.0:1789673083.724071:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738523776 00000100:00100000:1.0:1789673083.724073:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738523776 00000100:00100000:1.0:1789673083.724086:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789673083.724089:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738523264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.724112:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738523264:12345-0@lo:400:kworker.0 Request processed in 23us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673083.724116:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789673083.724123:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789673083.724126:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738523776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.724140:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738523776:12345-0@lo:400:kworker.0 Request processed in 14us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673083.724144:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789673083.724154:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738524288 00000100:00100000:1.0:1789673083.724156:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738524288 00000100:00100000:1.0:1789673083.724165:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738523392 00000100:00100000:1.0:1789673083.724167:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738523392 00000100:00100000:1.0:1789673083.724172:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738523904 00000100:00100000:1.0:1789673083.724178:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738523904 00000100:00100000:1.0:1789673083.724187:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738524416 00000100:00100000:1.0:1789673083.724188:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738524416 00000100:00100000:1.0:1789673083.724202:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789673083.724208:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738524288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.724236:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1876607738524288:12345-0@lo:400:kworker.0 Request processed in 28us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673083.724242:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789673083.724253:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789673083.724259:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738523392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.724284:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738523392:12345-0@lo:400:kworker.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673083.724290:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789673083.724301:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789673083.724307:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738523904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.724349:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1876607738523904:12345-0@lo:400:kworker.0 Request processed in 42us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673083.724355:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789673083.724367:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789673083.724373:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738524416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.724397:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1876607738524416:12345-0@lo:400:kworker.0 Request processed in 25us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673083.724402:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1789673083.724423:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789673083.724426:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789673083.724428:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789673083.724445:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738523392:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.724458:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1876607738523904:0@lo:400:kworker.0 00010000:00080000:1.0:1789673083.724465:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc4993e680 x1876607738524416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789673083.724472:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1876607738524416:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.724478:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738523264:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.724484:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738523776:0@lo:400:kworker.0 00000100:00100000:1.0:1789673083.724490:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1876607738524288:0@lo:400:kworker.0 00000100:00100000:0.0:1789673083.724588:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738523008 00000100:00100000:0.0:1789673083.724596:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738523008 00000100:00100000:0.0:1789673083.724628:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789673083.724633:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:3638:x1876607738523008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673083.724685:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:3638:x1876607738523008:12345-0@lo:400:kworker.0 Request processed in 52us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673083.724690:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789673083.724717:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb4744ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3638:1876607738523008:0@lo:400:kworker.0 00000100:00100000:0.0:1789673083.725344:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738524544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789673083.725382:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673083.725479:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738524544 00000100:00100000:2.0:1789673083.725484:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738524544 00000100:00100000:2.0:1789673083.725523:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789673083.725531:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738524544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789673083.725547:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789673083.725585:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738524544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673083.725591:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789673083.725654:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738524544:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789673083.974428:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789673084.882076:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673084.882152:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673084.882185:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673084.882207:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673084.882238:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673084.882254:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673084.882269:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673084.882284:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673084.882366:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673084.882395:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714321792 00000100:00100000:2.0:1789673084.882405:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714321792 00000100:00100000:2.0:1789673084.882462:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714322304 00000100:00100000:2.0:1789673084.882465:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714322304 00000100:00100000:2.0:1789673084.882480:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714321664 00000100:00100000:2.0:1789673084.882483:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714321664 00000100:00100000:2.0:1789673084.882494:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714322176 00000100:00100000:2.0:1789673084.882497:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714322176 00000100:00100000:2.0:1789673084.882515:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:2.0:1789673084.882526:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:2398:x1876607714321792:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789673084.882608:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:2398:x1876607714321792:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 83us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673084.882616:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:2.0:1789673084.882635:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:2.0:1789673084.882642:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:163c450b-674a-4081-bea4-a5f6f08422e7+5:2398:x1876607714322304:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789673084.882701:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:163c450b-674a-4081-bea4-a5f6f08422e7+5:2398:x1876607714322304:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 58us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673084.882708:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:2.0:1789673084.882721:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:2.0:1789673084.882728:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:2398:x1876607714321664:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789673084.882754:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:2398:x1876607714321664:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 27us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673084.882782:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:2.0:1789673084.882798:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:2.0:1789673084.882804:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:163c450b-674a-4081-bea4-a5f6f08422e7+6:2398:x1876607714322176:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789673084.882832:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:163c450b-674a-4081-bea4-a5f6f08422e7+6:2398:x1876607714322176:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 29us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673084.882838:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:1.0:1789673084.883054:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714322048 00000100:00100000:1.0:1789673084.883060:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714322048 00000100:00100000:1.0:1789673084.883090:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714322560 00000100:00100000:1.0:1789673084.883093:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714322560 00000100:00100000:1.0:1789673084.883106:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714321920 00000100:00100000:1.0:1789673084.883109:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714321920 00000100:00100000:1.0:1789673084.883122:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714322432 00000100:00100000:1.0:1789673084.883125:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714322432 00000100:00100000:1.0:1789673084.883139:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:1.0:1789673084.883146:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:2398:x1876607714322048:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789673084.883176:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:2398:x1876607714322048:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 31us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673084.883185:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 12 00000100:00100000:1.0:1789673084.883200:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:1.0:1789673084.883206:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:163c450b-674a-4081-bea4-a5f6f08422e7+6:2398:x1876607714322560:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789673084.883228:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:163c450b-674a-4081-bea4-a5f6f08422e7+6:2398:x1876607714322560:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 22us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673084.883247:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:1.0:1789673084.883259:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:1.0:1789673084.883265:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:2398:x1876607714321920:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789673084.883288:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:2398:x1876607714321920:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 23us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673084.883294:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:1.0:1789673084.883303:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:1.0:1789673084.883309:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:163c450b-674a-4081-bea4-a5f6f08422e7+5:2398:x1876607714322432:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789673084.883325:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:163c450b-674a-4081-bea4-a5f6f08422e7+5:2398:x1876607714322432:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 17us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673084.883331:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00080000:1.0:1789673084.883365:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789673084.883369:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789673084.883372:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789673084.883375:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789673084.886386:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714321536 00000100:00100000:3.0:1789673084.886400:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714321536 00000100:00100000:1.0:1789673084.886800:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 147 00000100:00100000:1.0:1789673084.886813:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:2398:x1876607714321536:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789673084.886902:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:2398:x1876607714321536:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 92us (4834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673084.886921:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 147 00010000:00010000:0.0:1789673084.996100:0:19759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789673085.253433:0:19462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 163c450b-674a-4081-bea4-a5f6f08422e7 00000020:00000080:1.0:1789673085.482162:0:20167:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc17229d80 20000000:00000080:1.0:1789673085.482181:0:20167:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cfb41af8400 uarg=0000000000000000 20000000:01000000:1.0:1789673085.482229:0:20167:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789673085.482234:0:20167:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789673085.482245:0:20167:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789673085.483159:0:20168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1789673085.483322:0:20167:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789673085.490725:0:20167:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789673085.490772:0:20167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cfb47476400/0x6c78c4f8c99666ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.490793:0:20167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfb482e4a00/0x6c78c4f8c9966342 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c996633b expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.490803:0:20167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d8cc800/0x6c78c4f8c9966350 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9966349 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.490810:0:20167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfb482e5e00/0x6c78c4f8c996638f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c9966388 expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.490838:0:20167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d8cd800/0x6c78c4f8c99664ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99664e6 expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.490850:0:20167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996663d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253fb expref: 12 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.490859:0:20167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cfb46aee200/0x6c78c4f8c996667c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2546b expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.490867:0:20167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cfb47476400/0x6c78c4f8c99666ad lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.490914:0:20167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfb46aee200/0x6c78c4f8c996667c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2546b expref: 12 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.490929:0:20167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfb46aee200/0x6c78c4f8c996667c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2546b expref: 12 pid: 17131 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673085.490945:0:20167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f679c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876607738524672:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789673085.491126:0:20167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996663d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253fb expref: 12 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.491136:0:20167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996663d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253fb expref: 12 pid: 17132 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673085.491147:0:20167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876607738524800:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789673085.491183:0:20167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d8cd800/0x6c78c4f8c99664ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c99664e6 expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.491204:0:20167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfc7d8cd800/0x6c78c4f8c99664ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c99664e6 expref: 23 pid: 17133 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673085.491215:0:20167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876607738524928:0@lo:104: 00000100:00100000:3.0:1789673085.491262:0:20167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789673085.491299:0:20167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfb482e5e00/0x6c78c4f8c996638f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9966388 expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.491307:0:20167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfb482e5e00/0x6c78c4f8c996638f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9966388 expref: 23 pid: 17133 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673085.491316:0:20167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876607738525056:0@lo:104: 00000100:00100000:3.0:1789673085.491337:0:20167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789673085.491371:0:20167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfc7d8cc800/0x6c78c4f8c9966350 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c9966349 expref: 23 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.491379:0:20167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfc7d8cc800/0x6c78c4f8c9966350 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c9966349 expref: 23 pid: 17131 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673085.491387:0:20167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f679500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876607738525184:0@lo:104: 00000100:00100000:3.0:1789673085.491408:0:20167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789673085.491425:0:20167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cfb482e4a00/0x6c78c4f8c9966342 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6c78c4f8c996633b expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.491433:0:20167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cfb482e4a00/0x6c78c4f8c9966342 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6c78c4f8c996633b expref: 23 pid: 17133 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673085.491441:0:20167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876607738525312:0@lo:104: 00000100:00100000:3.0:1789673085.491472:0:20167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673085.491484:0:20167:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc431710c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789673085.491576:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738524928 00000100:00100000:1.0:1789673085.491586:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738524928 00000100:00100000:1.0:1789673085.491630:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738525056 00000100:00100000:1.0:1789673085.491634:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738525056 00000100:00100000:1.0:1789673085.491645:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738525184 00000100:00100000:1.0:1789673085.491647:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738525184 00000100:00100000:1.0:1789673085.491684:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738525312 00000100:00100000:1.0:1789673085.491688:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738525312 00000100:00100000:1.0:1789673085.491705:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789673085.491714:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+6:20167:x1876607738524928:12345-0@lo:104: 00010000:00010000:1.0:1789673085.491728:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99664e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99664ed expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673085.491799:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789673085.491805:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+6:20167:x1876607738524928:12345-0@lo:104: Request processed in 93us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673085.491813:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789673085.491832:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789673085.491839:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+5:20167:x1876607738525056:12345-0@lo:104: 00010000:00010000:1.0:1789673085.491846:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c9966388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c996638f expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673085.491881:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789673085.491887:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+5:20167:x1876607738525056:12345-0@lo:104: Request processed in 49us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673085.491894:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789673085.491906:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789673085.491912:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+4:20167:x1876607738525184:12345-0@lo:104: 00010000:00010000:1.0:1789673085.491927:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c9966349 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9966350 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673085.491960:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789673085.491966:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+4:20167:x1876607738525184:12345-0@lo:104: Request processed in 55us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673085.491972:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789673085.491985:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789673085.491991:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+3:20167:x1876607738525312:12345-0@lo:104: 00010000:00010000:1.0:1789673085.491999:0:17122:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c996633b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9966342 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673085.492023:0:17122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789673085.492028:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+3:20167:x1876607738525312:12345-0@lo:104: Request processed in 38us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673085.492033:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789673085.492195:0:19759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789673085.492204:0:19759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99664e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c99664ed expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492213:0:19759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb46aef400 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789673085.492218:0:19759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99664e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c99664ed expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492227:0:19759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99664e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c99664ed expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789673085.492234:0:19759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99664e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c99664ed expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789673085.492241:0:19759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789673085.492286:0:19759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99664e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99664ed expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492304:0:19759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789673085.492326:0:19759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99664e6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99664ed expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492333:0:19759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfb46aef400/0x6c78c4f8c99664e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c99664ed expref: -99 pid: 19461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492349:0:19759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789673085.492352:0:19759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c9966388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c996638f expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492358:0:19759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cde00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789673085.492362:0:19759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c9966388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c996638f expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492369:0:19759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c9966388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c996638f expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789673085.492375:0:19759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c9966388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c996638f expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789673085.492380:0:19759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789673085.492396:0:19759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c9966388 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996638f expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492402:0:19759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789673085.492418:0:19759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c9966388 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996638f expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492426:0:19759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cde00/0x6c78c4f8c9966388 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c996638f expref: -99 pid: 18641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492445:0:19759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789673085.492448:0:19759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c9966349 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9966350 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492453:0:19759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd400 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789673085.492456:0:19759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c9966349 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9966350 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492463:0:19759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c9966349 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9966350 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789673085.492469:0:19759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c9966349 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9966350 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789673085.492475:0:19759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789673085.492490:0:19759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c9966349 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9966350 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492496:0:19759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789673085.492503:0:19759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c9966349 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9966350 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492509:0:19759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc7d8cd400/0x6c78c4f8c9966349 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9966350 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492517:0:19759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789673085.492520:0:19759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c996633b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6c78c4f8c9966342 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492536:0:19759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc52434e00 already unused, calling callback (ffffffffc127cc20) 10000000:00010000:0.0:1789673085.492539:0:19759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c996633b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6c78c4f8c9966342 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492547:0:19759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c996633b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6c78c4f8c9966342 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789673085.492553:0:19759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c996633b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6c78c4f8c9966342 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789673085.492558:0:19759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789673085.492572:0:19759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c996633b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9966342 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492579:0:19759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789673085.492586:0:19759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c996633b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9966342 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492592:0:19759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.150@tcp lock: ffff8cfc52434e00/0x6c78c4f8c996633b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6c78c4f8c9966342 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.492608:0:19759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673085.492610:0:19759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789673085.492611:0:19759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789673085.492627:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3638:1876607738525440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789673085.492715:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673085.492755:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789673085.492773:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3638:1876607738525824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789673085.492808:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673085.492840:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3635:1876607738525568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789673085.492863:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673085.492882:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789673085.492887:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3635:1876607738525696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789673085.492907:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673085.492934:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738525440 00000100:00100000:0.0:1789673085.492939:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738525440 00010000:00010000:0.0:1789673085.492963:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d8cd800/0x6c78c4f8c99664ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99664e6 expref: 24 pid: 17133 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673085.492979:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738525824 00000100:00100000:0.0:1789673085.492982:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738525824 00010000:00010000:0.0:1789673085.492995:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfb482e4a00/0x6c78c4f8c9966342 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c996633b expref: 25 pid: 17133 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673085.493005:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738525568 00000100:00100000:0.0:1789673085.493007:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738525568 00010000:00010000:0.0:1789673085.493016:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfb482e5e00/0x6c78c4f8c996638f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9966388 expref: 26 pid: 17133 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673085.493026:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738525696 00000100:00100000:0.0:1789673085.493028:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738525696 00010000:00010000:0.0:1789673085.493037:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d8cc800/0x6c78c4f8c9966350 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9966349 expref: 27 pid: 17131 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673085.493049:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789673085.493054:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+27:3638:x1876607738525440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789673085.493068:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789673085.493080:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d8cd800/0x6c78c4f8c99664ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c99664e6 expref: 27 pid: 17133 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.493089:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d8cd800/0x6c78c4f8c99664ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c99664e6 expref: 27 pid: 17133 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.493106:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789673085.493137:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+27:3638:x1876607738525440:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673085.493144:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789673085.493160:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789673085.493166:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+26:3638:x1876607738525824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789673085.493174:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789673085.493178:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfb482e4a00/0x6c78c4f8c9966342 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c996633b expref: 26 pid: 17133 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.493187:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfb482e4a00/0x6c78c4f8c9966342 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c996633b expref: 26 pid: 17133 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.493196:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789673085.493215:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+26:3638:x1876607738525824:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673085.493221:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789673085.493232:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789673085.493237:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+25:3635:x1876607738525568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789673085.493244:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789673085.493248:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfb482e5e00/0x6c78c4f8c996638f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9966388 expref: 25 pid: 17133 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.493266:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfb482e5e00/0x6c78c4f8c996638f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9966388 expref: 25 pid: 17133 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.493275:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789673085.493301:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+25:3635:x1876607738525568:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673085.493308:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789673085.493319:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789673085.493324:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:3635:x1876607738525696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789673085.493331:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789673085.493336:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d8cc800/0x6c78c4f8c9966350 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6c78c4f8c9966349 expref: 24 pid: 17131 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.493344:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d8cc800/0x6c78c4f8c9966350 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6c78c4f8c9966349 expref: 24 pid: 17131 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673085.493353:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789673085.493373:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:3635:x1876607738525696:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673085.493378:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789673085.493418:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3635:1876607738525696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789673085.493427:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3635:1876607738525568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789673085.493450:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3638:1876607738525824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789673085.493458:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3638:1876607738525440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789673085.493691:0:20167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8cd800/0x6c78c4f8c99664ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c99664e6 expref: 23 pid: 17133 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673085.493706:0:20167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876607738524928:0@lo:104: 00010000:00010000:3.0:1789673085.493718:0:20167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfb482e5e00/0x6c78c4f8c996638f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9966388 expref: 22 pid: 17133 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673085.493726:0:20167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876607738525056:0@lo:104: 00010000:00010000:3.0:1789673085.493737:0:20167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8cc800/0x6c78c4f8c9966350 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c9966349 expref: 21 pid: 17131 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673085.493745:0:20167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f679500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876607738525184:0@lo:104: 00010000:00010000:3.0:1789673085.493754:0:20167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfb482e4a00/0x6c78c4f8c9966342 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6c78c4f8c996633b expref: 20 pid: 17133 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673085.493775:0:20167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876607738525312:0@lo:104: 00010000:00010000:2.0:1789673085.494521:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789673085.494528:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789673085.499350:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673085.499440:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673085.499484:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714322688 00000100:00100000:2.0:1789673085.499495:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714322688 00010000:00010000:2.0:1789673085.499561:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfb46aee200/0x6c78c4f8c996667c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2546b expref: 13 pid: 17131 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673085.499597:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714322816 00000100:00100000:2.0:1789673085.499600:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714322816 00010000:00010000:2.0:1789673085.499614:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996663d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253fb expref: 14 pid: 17132 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673085.499635:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:2.0:1789673085.499644:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc818f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+14:2395:x1876607714322688:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789673085.499689:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789673085.499697:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfb46aee200/0x6c78c4f8c996667c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2546b expref: 14 pid: 17131 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673085.499711:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfb46aee200/0x6c78c4f8c996667c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2546b expref: 14 pid: 17131 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673085.499754:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789673085.499826:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc818f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+14:2395:x1876607714322688:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 183us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673085.499834:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 13 00000100:00100000:2.0:1789673085.499893:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 14 00000100:00100000:2.0:1789673085.499900:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:2395:x1876607714322816:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789673085.499909:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789673085.499913:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996663d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253fb expref: 13 pid: 17132 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673085.499922:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996663d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253fb expref: 13 pid: 17132 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673085.499934:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cfb47476400/0x6c78c4f8c99666ad lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673085.499942:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb47476400/0x6c78c4f8c99666ad lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673085.499959:0:17124:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfb47476400/0x6c78c4f8c99666ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673085.499966:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cfb47476400/0x6c78c4f8c99666ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673085.499973:0:17124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cfb47476400/0x6c78c4f8c99666ad lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673085.499980:0:17124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cfb47476400/0x6c78c4f8c99666ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673085.499992:0:17124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47476400 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789673085.499996:0:17124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cfb47476400/0x6c78c4f8c99666ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673085.500005:0:17124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cfb47476400/0x6c78c4f8c99666ad lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673085.500015:0:17124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cfb47476400/0x6c78c4f8c99666ad lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673085.500028:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789673085.500048:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:2395:x1876607714322816:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 148us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673085.500054:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 14 00010000:00010000:3.0:1789673085.501236:0:20167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfb46aee200/0x6c78c4f8c996667c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2546b expref: 12 pid: 17131 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673085.501256:0:20167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f679c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876607738524672:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789673085.501269:0:20167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfc7d8cc200/0x6c78c4f8c996663d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd253fb expref: 11 pid: 17132 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673085.501278:0:20167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20167:1876607738524800:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789673085.501321:0:20167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cfb47476400/0x6c78c4f8c99666ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.501346:0:20167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cfb47476400/0x6c78c4f8c99666ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.501353:0:20167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cfb47476400/0x6c78c4f8c99666ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673085.501360:0:20167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cfb47476400/0x6c78c4f8c99666ad lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673085.767492:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738525952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789673085.767583:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673085.767854:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738525952 00000100:00100000:2.0:1789673085.767863:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738525952 00000100:00100000:2.0:1789673085.767944:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789673085.767954:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738525952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789673085.767984:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789673085.768041:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738525952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673085.768047:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1789673085.768176:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789673085.768227:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738525952:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789673086.020866:0:19759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789673086.600804:0:17135:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789673086.600812:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfb467e4000 from 13 10000000:01000000:3.0:1789673086.600816:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789673086.600870:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb47476200/0x6c78c4f8c99666b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.600882:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfb47476200/0x6c78c4f8c99666b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.600893:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfb47476200/0x6c78c4f8c99666b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673086.600920:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738526080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789673086.600992:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673086.601761:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789673086.602583:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738526080 00000100:00100000:2.0:1789673086.602595:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738526080 00000100:00100000:2.0:1789673086.602860:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789673086.602871:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+20:17135:x1876607738526080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789673086.602887:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673086.602919:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d886000/0x6c78c4f8c99666bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99666b4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673086.602948:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d886000/0x6c78c4f8c99666bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99666b4 expref: 21 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673086.602959:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d886000/0x6c78c4f8c99666bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99666b4 expref: 21 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673086.602969:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886000, rc 0) 00000100:00100000:2.0:1789673086.603051:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:17135:x1876607738526080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673086.603058:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789673086.603243:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738526080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789673086.603264:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfb47476200/0x6c78c4f8c99666b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99666bb expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.603285:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfb47476200/0x6c78c4f8c99666b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99666bb expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673086.603370:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738526208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789673086.603416:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673086.604022:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789673086.604111:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738526208 00000100:00100000:1.0:1789673086.604118:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738526208 00000100:00100000:1.0:1789673086.604148:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789673086.604156:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:17135:x1876607738526208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789673086.604287:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:17135:x1876607738526208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673086.604296:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789673086.604808:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738526208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789673086.604853:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738526336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789673086.604905:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673086.604937:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789673086.605056:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738526336 00000100:00100000:0.0:1789673086.605062:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738526336 00000100:00100000:0.0:1789673086.605104:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789673086.605112:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:17135:x1876607738526336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789673086.605208:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:17135:x1876607738526336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673086.605217:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789673086.605258:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738526336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789673086.610957:0:20207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789673086.614102:0:17135:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789673086.614150:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789673086.614163:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb47476200/0x6c78c4f8c99666b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99666bb expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.614177:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfb47476200/0x6c78c4f8c99666b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99666bb expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789673086.614188:0:17135:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789673086.614191:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc6596c000 from 13 10000000:01000000:3.0:1789673086.614194:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789673086.614231:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb47476800/0x6c78c4f8c99666c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.614238:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfb47476800/0x6c78c4f8c99666c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.614260:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfb47476800/0x6c78c4f8c99666c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673086.614286:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f679c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738526464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789673086.614356:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673086.614406:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3480 going to sleep for 11 seconds 00000100:00100000:2.0:1789673086.614499:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738526464 00000100:00100000:2.0:1789673086.614507:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738526464 00000100:00100000:2.0:1789673086.614559:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789673086.614568:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+21:17135:x1876607738526464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789673086.614581:0:17132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673086.614596:0:17132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c99666c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99666c2 expref: -99 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673086.614619:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c99666c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99666c2 expref: 22 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673086.614629:0:17132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d886200/0x6c78c4f8c99666c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99666c2 expref: 22 pid: 17132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673086.614637:0:17132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886200, rc 0) 00000100:00100000:2.0:1789673086.614710:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:17135:x1876607738526464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673086.614724:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789673086.618960:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f679c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738526464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789673086.618995:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfb47476800/0x6c78c4f8c99666c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99666c9 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673086.619020:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfb47476800/0x6c78c4f8c99666c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99666c9 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673086.619119:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738526592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789673086.619181:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673086.619225:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb474659c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789673086.619407:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738526592 00000100:00100000:2.0:1789673086.619415:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738526592 00000100:00100000:2.0:1789673086.619471:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789673086.619481:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:17135:x1876607738526592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789673086.619628:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:17135:x1876607738526592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673086.619636:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789673086.619877:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738526592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789673086.619911:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4993e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738526720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789673086.619959:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673086.619979:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb474659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789673086.620033:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738526720 00000100:00100000:3.0:1789673086.620039:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738526720 00000100:00100000:3.0:1789673086.620076:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789673086.620084:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d2f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:17135:x1876607738526720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789673086.620177:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d2f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:17135:x1876607738526720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673086.620184:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789673086.620224:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4993e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738526720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789673086.622625:0:20209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789673086.622935:0:17135:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789673086.622963:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789673086.622976:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb47476800/0x6c78c4f8c99666c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99666c9 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673086.622989:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfb47476800/0x6c78c4f8c99666c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99666c9 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789673086.623001:0:17135:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789673086.623004:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfb46b12800 from 13 10000000:01000000:2.0:1789673086.623007:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789673086.623051:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c99666d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673086.623060:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c99666d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673086.623071:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c99666d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673086.623098:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738526848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789673086.623184:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673086.623230:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43103e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789673086.623284:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738526848 00000100:00100000:3.0:1789673086.623292:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738526848 00000100:00100000:3.0:1789673086.623340:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789673086.623350:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+22:17135:x1876607738526848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789673086.623364:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673086.623379:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb47477a00/0x6c78c4f8c99666d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99666d0 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.623403:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb47477a00/0x6c78c4f8c99666d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99666d0 expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.623427:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb47477a00/0x6c78c4f8c99666d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99666d0 expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.623436:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb47477a00, rc 0) 00000100:00100000:3.0:1789673086.624086:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81584450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:17135:x1876607738526848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 733us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673086.624095:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789673086.626164:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738526848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789673086.626197:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c99666d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99666d7 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673086.626210:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c99666d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99666d7 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673086.626310:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738526976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789673086.626371:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673086.626421:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43103e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789673086.626528:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738526976 00000100:00100000:0.0:1789673086.626536:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738526976 00000100:00100000:0.0:1789673086.626588:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789673086.626598:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:17135:x1876607738526976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789673086.626764:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81586450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:17135:x1876607738526976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673086.626773:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789673086.627859:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738526976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789673086.627906:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738527104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789673086.627958:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673086.627984:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc43103e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789673086.628067:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738527104 00000100:00100000:0.0:1789673086.628074:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738527104 00000100:00100000:0.0:1789673086.628114:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789673086.628122:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:17135:x1876607738527104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789673086.628228:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81587450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:17135:x1876607738527104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673086.628237:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789673086.628328:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738527104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789673086.629311:0:20210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789673086.638811:0:17135:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789673086.638860:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789673086.638874:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c99666d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99666d7 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.638888:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfc7d887600/0x6c78c4f8c99666d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99666d7 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789673086.638900:0:17135:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789673086.638903:0:17135:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cfc7f765000 from 13 10000000:01000000:3.0:1789673086.638907:0:17135:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789673086.638947:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb47477c00/0x6c78c4f8c99666de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.638956:0:17135:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.150@tcp lock: ffff8cfb47477c00/0x6c78c4f8c99666de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.638969:0:17135:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.150@tcp lock: ffff8cfb47477c00/0x6c78c4f8c99666de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673086.638998:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738527232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789673086.639081:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673086.639128:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7c5e3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789673086.639157:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738527232 00000100:00100000:3.0:1789673086.639165:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738527232 00000100:00100000:3.0:1789673086.639212:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789673086.639221:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+23:17135:x1876607738527232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789673086.639235:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673086.639248:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb47477600/0x6c78c4f8c99666e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6c78c4f8c99666de expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.639272:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb47477600/0x6c78c4f8c99666e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6c78c4f8c99666de expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.639283:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb47477600/0x6c78c4f8c99666e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6c78c4f8c99666de expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.639290:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb47477600, rc 0) 00000100:00100000:3.0:1789673086.639327:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:17135:x1876607738527232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673086.639334:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789673086.639383:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738527232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789673086.639399:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.150@tcp lock: ffff8cfb47477c00/0x6c78c4f8c99666de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99666e5 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.639409:0:17135:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.150@tcp lock: ffff8cfb47477c00/0x6c78c4f8c99666de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6c78c4f8c99666e5 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673086.639463:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738527360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789673086.639495:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673086.639510:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4a65b000 going to sleep for 11 seconds 00000100:00100000:3.0:1789673086.639523:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738527360 00000100:00100000:3.0:1789673086.639526:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738527360 00000100:00100000:3.0:1789673086.639548:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789673086.639555:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:17135:x1876607738527360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789673086.639770:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81586c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:17135:x1876607738527360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673086.639778:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789673086.639822:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738527360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789673086.639848:0:17135:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f67a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738527488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789673086.639892:0:17135:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673086.639905:0:17135:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc4a65b000 going to sleep for 11 seconds 00000100:00100000:3.0:1789673086.639919:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738527488 00000100:00100000:3.0:1789673086.639923:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738527488 00000100:00100000:3.0:1789673086.639944:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789673086.639950:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:17135:x1876607738527488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789673086.640030:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81587c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:17135:x1876607738527488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673086.640037:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789673086.640075:0:17135:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f67a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:17135:1876607738527488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789673086.642800:0:20214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789673086.642908:0:17135:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789673086.642934:0:17135:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789673086.642946:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.150@tcp lock: ffff8cfb47477c00/0x6c78c4f8c99666de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99666e5 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673086.642969:0:17135:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.150@tcp lock: ffff8cfb47477c00/0x6c78c4f8c99666de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6c78c4f8c99666e5 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673086.788948:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738527616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789673086.789055:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673086.789109:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789673086.789116:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738527744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789673086.789138:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673086.789178:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738527616 00000100:00100000:0.0:1789673086.789190:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738527616 00000100:00100000:0.0:1789673086.789238:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738527744 00000100:00100000:0.0:1789673086.789241:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738527744 00000100:00100000:0.0:1789673086.789255:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789673086.789263:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738527616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789673086.789301:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789673086.789348:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738527616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673086.789355:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789673086.789373:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789673086.789379:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738527744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789673086.789396:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789673086.789425:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1876607738527744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673086.789431:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789673086.789481:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1876607738527744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789673086.789493:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738527616:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789673087.043905:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789673087.379268:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673087.379470:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714322944 00000100:00100000:3.0:1789673087.379482:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714322944 00000100:00100000:3.0:1789673087.380684:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 160 00000100:00100000:3.0:1789673087.380701:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+11:14912:x1876607714322944:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789673087.380720:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673087.380748:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfb47476000/0x6c78c4f8c99666ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd254a3 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673087.380779:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfb47476000/0x6c78c4f8c99666ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254a3 expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673087.380792:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfb47476000/0x6c78c4f8c99666ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254a3 expref: 12 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673087.380802:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb47476000, rc 0) 00000100:00100000:3.0:1789673087.380872:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81586050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+12:14912:x1876607714322944:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 176us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673087.380879:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 160 00000100:00100000:3.0:1789673087.394960:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673087.396834:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714323072 00000100:00100000:2.0:1789673087.396846:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714323072 00000100:00100000:2.0:1789673087.396909:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 161 00000100:00100000:2.0:1789673087.396920:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+12:14912:x1876607714323072:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789673087.397085:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81584850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+12:14912:x1876607714323072:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 166us (2136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673087.397104:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 161 00000100:00100000:2.0:1789673087.403974:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673087.404137:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714323200 00000100:00100000:3.0:1789673087.404149:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714323200 00000100:00100000:3.0:1789673087.404216:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 162 00000100:00100000:3.0:1789673087.404227:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+12:14912:x1876607714323200:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789673087.404381:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81585050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+12:14912:x1876607714323200:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 Request processed in 156us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673087.404390:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 162 00000100:00100000:3.0:1789673087.415973:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673087.416024:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714323328 00000100:00100000:2.0:1789673087.416035:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714323328 00000100:00100000:2.0:1789673087.416100:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 163 00000100:00100000:2.0:1789673087.416112:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+12:14912:x1876607714323328:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789673087.416129:0:17131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673087.416153:0:17131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cfc7d887000/0x6c78c4f8c99666f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd254aa expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673087.416184:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cfc7d887000/0x6c78c4f8c99666f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254aa expref: 13 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673087.416196:0:17131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cfc7d887000/0x6c78c4f8c99666f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254aa expref: 13 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673087.416205:0:17131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887000, rc 0) 00000100:00100000:2.0:1789673087.416262:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:14912:x1876607714323328:12345-192.168.201.50@tcp:101:ll_cfg_requeue.0 Request processed in 153us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673087.416269:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 163 00000100:00100000:3.0:1789673087.423883:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673087.423929:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714323456 00000100:00100000:3.0:1789673087.423939:0:17133:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714323456 00000100:00100000:3.0:1789673087.424002:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 164 00000100:00100000:3.0:1789673087.424013:0:17133:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:14912:x1876607714323456:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789673087.424175:0:17133:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:14912:x1876607714323456:12345-192.168.201.50@tcp:501:ll_cfg_requeue.0 Request processed in 164us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673087.424182:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 164 00000100:00100000:3.0:1789673087.427135:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673087.427227:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714323584 00000100:00100000:1.0:1789673087.427237:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714323584 00000100:00100000:1.0:1789673087.427322:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 165 00000100:00100000:1.0:1789673087.427333:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:14912:x1876607714323584:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789673087.427493:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81584c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:14912:x1876607714323584:12345-192.168.201.50@tcp:503:ll_cfg_requeue.0 Request processed in 160us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673087.427502:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 165 00000040:00080000:1.0:1789673087.749577:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789673087.814191:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789673087.814217:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738527872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789673087.814294:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673087.814401:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738527872 00000100:00100000:2.0:1789673087.814411:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738527872 00000100:00100000:2.0:1789673087.814486:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789673087.814496:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738527872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789673087.814525:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789673087.814575:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876607738527872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673087.814599:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789673087.814647:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1876607738527872:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789673087.815800:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789673088.069259:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789673088.586614:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673088.589238:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714323712 00000100:00100000:2.0:1789673088.589255:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714323712 00000100:00100000:2.0:1789673088.589925:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:2.0:1789673088.589942:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:15580:x1876607714323712:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789673088.589964:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673088.589992:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c99666fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd254b1 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.590064:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9966701 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.590091:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9966701 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.590108:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9966701 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.590123:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9966708 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.590130:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9966708 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.590137:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9966708 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.590240:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887c00/0x6c78c4f8c996670f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.590248:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887c00/0x6c78c4f8c996670f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.590255:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887c00/0x6c78c4f8c996670f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789673088.591166:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789673088.591173:0:17138:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789673088.591220:0:17138:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887c00/0x6c78c4f8c996670f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.591234:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9966701 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.591242:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9966701 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.591249:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9966701 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.591255:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789673088.591259:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9966701 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.591267:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9966701 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.591279:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc462d0f00) 00010000:00010000:2.0:1789673088.592097:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789673088.592105:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9966701 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.592114:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9966701 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.592135:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9966708 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.592141:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9966708 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.592146:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9966708 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.592151:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886c00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:2.0:1789673088.592155:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9966708 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.592161:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9966708 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.592171:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cfc4990a300) 00010000:00010000:2.0:1789673088.592174:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789673088.592177:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9966708 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.592183:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886c00/0x6c78c4f8c9966708 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.592241:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886800/0x6c78c4f8c99666fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254b1 expref: 8 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.592270:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887c00/0x6c78c4f8c996670f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254b1 expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.592277:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cfc4990a100) 00010000:00010000:2.0:1789673088.592279:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789673088.592282:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887c00, rc 0) 00000100:00080000:1.0:1789673088.593473:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789673088.594001:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+7:15580:x1876607714323712:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 4061us (7392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673088.594011:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:1.0:1789673088.603261:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673088.603351:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714323840 00000100:00100000:3.0:1789673088.603362:0:17150:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714323840 00000100:00100000:3.0:1789673088.603432:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:3.0:1789673088.603444:0:17150:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:10bccd63-9b9d-4821-aed0-aaa14fbada75+7:15580:x1876607714323840:12345-192.168.201.50@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789673088.604060:0:17150:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:10bccd63-9b9d-4821-aed0-aaa14fbada75+7:15580:x1876607714323840:12345-192.168.201.50@tcp:900:lhsmtool_posix.0 Request processed in 618us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673088.604070:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:1.0:1789673088.606347:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673088.606605:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714324096 00000100:00100000:0.0:1789673088.606615:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714324096 00000100:00100000:0.0:1789673088.606712:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:0.0:1789673088.606723:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+7:15580:x1876607714324096:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789673088.606759:0:19758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673088.606784:0:19758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9966716 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd254b8 expref: -99 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.607262:0:19758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996671d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.607278:0:19758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996671d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.607367:0:19758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996671d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.607387:0:19758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966724 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.607396:0:19758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966724 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.607403:0:19758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966724 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.607533:0:19758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c996672b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.607542:0:19758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c996672b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.607548:0:19758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c996672b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789673088.607558:0:19758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789673088.607958:0:19758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996671d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.607967:0:19758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996671d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.607975:0:19758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996671d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.607981:0:19758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789673088.607986:0:19758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996671d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.607994:0:19758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996671d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.608007:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cfc4990a100) 00010000:00010000:0.0:1789673088.608010:0:19758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789673088.608015:0:19758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996671d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.608021:0:19758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996671d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.608036:0:19758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966724 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.608042:0:19758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966724 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.608048:0:19758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966724 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.608064:0:19758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789673088.608067:0:19758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966724 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.608074:0:19758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966724 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.608082:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cfb46b95d00) 00010000:00010000:0.0:1789673088.608084:0:19758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789673088.608087:0:19758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966724 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.608093:0:19758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966724 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.609162:0:19758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c9966716 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254b8 expref: 10 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.609185:0:19758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc800/0x6c78c4f8c996672b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254b8 expref: 9 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.614872:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfb46b95200) 00010000:00010000:0.0:1789673088.614882:0:19758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789673088.614890:0:19758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cc800, rc 0) 00000100:00100000:0.0:1789673088.614997:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+9:15580:x1876607714324096:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 8271us (8651us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789673088.615006:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:0.0:1789673088.619151:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673088.619484:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714324224 00000100:00100000:3.0:1789673088.619496:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714324224 00000100:00100000:3.0:1789673088.619566:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:3.0:1789673088.619578:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7d8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+9:15580:x1876607714324224:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789673088.619733:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7d8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+9:15580:x1876607714324224:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 Request processed in 157us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673088.619741:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 25 00000100:00100000:3.0:1789673088.621894:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673088.621990:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714324352 00000100:00100000:1.0:1789673088.622000:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714324352 00000100:00100000:1.0:1789673088.622080:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:1.0:1789673088.622092:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:15580:x1876607714324352:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1789673088.622831:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1789673088.625309:0:17139:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3179us 00000100:00100000:1.0:1789673088.670118:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:15580:x1876607714324352:12345-192.168.201.50@tcp:59:lhsmtool_posix.0 Request processed in 48016us (48219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673088.670135:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:1.0:1789673088.681816:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673088.681917:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714324480 00000100:00100000:3.0:1789673088.681928:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714324480 00000100:00100000:3.0:1789673088.681985:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:3.0:1789673088.681995:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+9:15586:x1876607714324480:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789673088.682014:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673088.682035:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477200/0x6c78c4f8c9966739 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd254bf expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682105:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966740 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682120:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966740 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682132:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966740 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682147:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966747 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682153:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682178:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682244:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966740 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682252:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966740 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682259:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966740 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682264:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47476400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673088.682269:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966740 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682277:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966740 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682289:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc462d0f00) 00010000:00010000:3.0:1789673088.682292:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789673088.682296:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966740 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682302:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966740 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682314:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682319:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966747 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682332:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966747 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682338:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47477e00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673088.682341:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966747 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682347:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966747 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682354:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cfc45bd3200) 00010000:00010000:3.0:1789673088.682357:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789673088.682360:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966747 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682366:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966747 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682397:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477200/0x6c78c4f8c9966739 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254bf expref: 10 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682406:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc462d0f00) 00010000:00010000:3.0:1789673088.682409:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789673088.682412:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477200/0x6c78c4f8c9966739 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254bf expref: 10 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.682420:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb47477200, rc 0) 00000100:00100000:3.0:1789673088.682490:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+9:15586:x1876607714324480:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 496us (684us total) trans 0 rc 301/301 00000100:00100000:3.0:1789673088.682506:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:3.0:1789673088.687720:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673088.687856:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714324608 00000100:00100000:2.0:1789673088.687866:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714324608 00000100:00100000:2.0:1789673088.687916:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:2.0:1789673088.687926:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:10bccd63-9b9d-4821-aed0-aaa14fbada75+9:15586:x1876607714324608:12345-192.168.201.50@tcp:700:lfs.0 00000100:00100000:2.0:1789673088.688012:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:10bccd63-9b9d-4821-aed0-aaa14fbada75+9:15586:x1876607714324608:12345-192.168.201.50@tcp:700:lfs.0 Request processed in 88us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673088.688020:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:1.0:1789673088.690313:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673088.690423:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714324864 00000100:00100000:0.0:1789673088.690434:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714324864 00000100:00100000:0.0:1789673088.690498:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:0.0:1789673088.690508:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+9:15586:x1876607714324864:12345-192.168.201.50@tcp:36:lfs.0 00010000:00010000:0.0:1789673088.690564:0:19758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789673088.690591:0:19758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c9966667 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2542c expref: 9 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.690611:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc462d0f00) 00010000:00010000:0.0:1789673088.690616:0:19758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789673088.690735:0:19758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996674e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.690749:0:19758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c99666a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2549c expref: 5 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.690758:0:19758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996674e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.690794:0:19758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c99666a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2549c expref: 5 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.690808:0:19758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c99666a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2549c expref: 5 pid: 19758 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673088.690823:0:19758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19758:1876607738528000:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789673088.691135:0:19758:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc7d64cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789673088.695535:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673088.695631:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714324992 00000100:00100000:2.0:1789673088.695640:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714324992 00010000:00010000:2.0:1789673088.695737:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c99666a6 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2549c expref: 6 pid: 19758 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673088.695784:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00100000:2.0:1789673088.695795:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:163c450b-674a-4081-bea4-a5f6f08422e7+6:2395:x1876607714324992:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789673088.695811:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789673088.695819:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c99666a6 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2549c expref: 6 pid: 19758 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.695844:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c99666a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2549c expref: 6 pid: 19758 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.695877:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc462d0f00) 00010000:00010000:2.0:1789673088.695884:0:17124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996674e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.695894:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996674e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.695901:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996674e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.695923:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789673088.695979:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:163c450b-674a-4081-bea4-a5f6f08422e7+6:2395:x1876607714324992:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 186us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673088.695987:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 15 00000100:00080000:3.0:1789673088.697061:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789673088.697333:0:19758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c99666a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2549c expref: 5 pid: 19758 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673088.697370:0:19758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19758:1876607738528000:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789673088.697393:0:19758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996674e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.697403:0:19758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996674e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.697410:0:19758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996674e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.697435:0:19758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966755 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.697445:0:19758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.697454:0:19758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.699075:0:19758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996675c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.699092:0:19758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996675c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.699102:0:19758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996675c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789673088.699121:0:19758:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1dbd18c reply state 000000006f924e41 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996675c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.699144:0:19758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996675c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.699151:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfb46b95600) 00010000:00010000:0.0:1789673088.699154:0:19758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789673088.699158:0:19758:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789673088.699164:0:19758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789673088.699172:0:19758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996674e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.699179:0:19758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996674e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.699185:0:19758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996674e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.699403:0:19758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789673088.699407:0:19758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996674e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.699416:0:19758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996674e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.699427:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc462d0f00) 00010000:00010000:0.0:1789673088.699430:0:19758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789673088.699434:0:19758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996674e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.699439:0:19758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996674e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789673088.699468:0:19758:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1dbd18c reply state 000000006f924e41 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.699476:0:19758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966755 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.699482:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cfb46b95d00) 00010000:00010000:0.0:1789673088.699483:0:19758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789673088.699485:0:19758:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789673088.699685:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+10:15586:x1876607714324864:12345-192.168.201.50@tcp:36:lfs.0 Request processed in 9140us (9343us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789673088.699693:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:2.0:1789673088.763030:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673088.763135:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714325120 00000100:00100000:3.0:1789673088.763146:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714325120 00000100:00100000:3.0:1789673088.763302:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:3.0:1789673088.763313:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+10:15594:x1876607714325120:12345-192.168.201.50@tcp:101:lctl.0 00010000:00010000:3.0:1789673088.763341:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673088.763364:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966763 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd254c6 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.763434:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c996676a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.763449:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c996676a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.763461:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c996676a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789673088.763508:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789673088.763513:0:17140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789673088.763556:0:17140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c996676a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.763582:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966763 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254c6 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.763628:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476c00/0x6c78c4f8c996676a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254c6 expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.763637:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc45bd3200) 00010000:00010000:3.0:1789673088.763640:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789673088.763644:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb47476c00, rc 0) 00000100:00100000:3.0:1789673088.763774:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+11:15594:x1876607714325120:12345-192.168.201.50@tcp:101:lctl.0 Request processed in 463us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673088.763783:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 29 00000040:00080000:1.0:1789673088.772402:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789673088.786725:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673088.786883:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714325248 00000100:00100000:1.0:1789673088.786893:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714325248 00000100:00100000:1.0:1789673088.786950:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:1.0:1789673088.786960:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:163c450b-674a-4081-bea4-a5f6f08422e7+5:15595:x1876607714325248:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:1.0:1789673088.786983:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789673088.787005:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4800/0x6c78c4f8c9966771 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd254cd expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673088.787072:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9966778 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673088.787087:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9966778 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673088.787101:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9966778 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789673088.787176:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789673088.787180:0:17139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789673088.787211:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9966778 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673088.787237:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4800/0x6c78c4f8c9966771 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254cd expref: 7 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673088.787257:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e5000/0x6c78c4f8c9966778 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254cd expref: 6 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673088.787265:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc45bd3200) 00010000:00010000:1.0:1789673088.787268:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789673088.787272:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e5000, rc 0) 00000100:00100000:1.0:1789673088.787341:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:163c450b-674a-4081-bea4-a5f6f08422e7+6:15595:x1876607714325248:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 383us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673088.787349:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 30 00000100:00100000:1.0:1789673088.790344:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673088.790490:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714325376 00000100:00100000:0.0:1789673088.790500:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714325376 00000100:00100000:0.0:1789673088.790564:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:0.0:1789673088.790573:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:163c450b-674a-4081-bea4-a5f6f08422e7+6:15595:x1876607714325376:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789673088.790594:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673088.790615:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996677f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd254d4 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.790738:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9966786 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.790751:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9966786 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.790762:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9966786 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.790797:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c996678d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.790805:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c996678d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.790811:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c996678d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.790896:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cde00/0x6c78c4f8c9966794 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.790905:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cde00/0x6c78c4f8c9966794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.790912:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cde00/0x6c78c4f8c9966794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789673088.790952:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789673088.790956:0:17138:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789673088.790978:0:17138:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cde00/0x6c78c4f8c9966794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.790991:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9966786 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.790998:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9966786 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.791004:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9966786 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.791021:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789673088.791025:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9966786 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.791033:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9966786 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.791046:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc45bd3200) 00010000:00010000:0.0:1789673088.791049:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789673088.791054:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9966786 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.791059:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c9966786 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.791074:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c996678d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.791080:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c996678d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.791085:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c996678d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.791090:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789673088.791093:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c996678d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.791100:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c996678d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.791120:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cfb46b95d00) 00010000:00010000:0.0:1789673088.791122:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789673088.791126:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c996678d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.791132:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c996678d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.791158:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c996677f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254d4 expref: 8 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.791172:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cde00/0x6c78c4f8c9966794 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254d4 expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.791179:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfb46b95600) 00010000:00010000:0.0:1789673088.791181:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789673088.791184:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cde00, rc 0) 00000100:00100000:0.0:1789673088.791367:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:163c450b-674a-4081-bea4-a5f6f08422e7+7:15595:x1876607714325376:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 794us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673088.791375:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 31 00000100:00100000:2.0:1789673088.795620:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673088.795778:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714325504 00000100:00100000:1.0:1789673088.795790:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714325504 00000100:00080000:3.0:1789673088.795956:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789673088.796046:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:1.0:1789673088.796059:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:163c450b-674a-4081-bea4-a5f6f08422e7+5:15595:x1876607714325504:12345-192.168.201.50@tcp:900:lfs.0 00000100:00100000:1.0:1789673088.796201:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:163c450b-674a-4081-bea4-a5f6f08422e7+5:15595:x1876607714325504:12345-192.168.201.50@tcp:900:lfs.0 Request processed in 133us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673088.796210:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:1.0:1789673088.802717:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673088.803645:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714325760 00000100:00100000:3.0:1789673088.803682:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714325760 00000100:00100000:3.0:1789673088.803765:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:3.0:1789673088.803777:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4993e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:163c450b-674a-4081-bea4-a5f6f08422e7+7:15595:x1876607714325760:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789673088.803798:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673088.803819:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c996679b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd254db expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789673088.803995:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789673088.804145:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c996679b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254db expref: 9 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.804159:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc45bd3200) 00010000:00010000:3.0:1789673088.804162:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789673088.804256:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c996679b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254db expref: 9 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.804280:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb47477e00, rc 0) 00000100:00100000:3.0:1789673088.804353:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4993e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:163c450b-674a-4081-bea4-a5f6f08422e7+8:15595:x1876607714325760:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 579us (1703us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1789673088.804360:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 32 00000100:00100000:2.0:1789673088.807269:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673088.807390:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714326016 00000100:00100000:0.0:1789673088.807400:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714326016 00000100:00100000:0.0:1789673088.807480:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:0.0:1789673088.807488:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:163c450b-674a-4081-bea4-a5f6f08422e7+8:15595:x1876607714326016:12345-192.168.201.50@tcp:36:lfs.0 00010000:00010000:0.0:1789673088.807545:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789673088.807573:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cde00/0x6c78c4f8c9966794 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254d4 expref: 8 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.807609:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfb46b95600) 00010000:00010000:0.0:1789673088.807612:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789673088.807632:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99667a9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.807642:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99667a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.807649:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99667a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789673088.808839:0:17138:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecf8622a reply state 00000000c4259604 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99667a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.808858:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99667a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.808865:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfb46b95600) 00010000:00010000:0.0:1789673088.808868:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1789673088.808871:0:17138:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789673088.808880:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789673088.808972:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:163c450b-674a-4081-bea4-a5f6f08422e7+9:15595:x1876607714326016:12345-192.168.201.50@tcp:36:lfs.0 Request processed in 1481us (1708us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789673088.808980:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 33 00000100:00100000:2.0:1789673088.812602:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673088.812788:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714326272 00000100:00100000:0.0:1789673088.812798:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714326272 00000100:00100000:0.0:1789673088.812895:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:0.0:1789673088.812906:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:163c450b-674a-4081-bea4-a5f6f08422e7+9:15595:x1876607714326272:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:0.0:1789673088.813178:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:163c450b-674a-4081-bea4-a5f6f08422e7+10:15595:x1876607714326272:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 273us (584us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789673088.813461:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:1.0:1789673088.816224:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673088.816600:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714326528 00000100:00100000:0.0:1789673088.816612:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714326528 00000100:00100000:0.0:1789673088.816724:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:0.0:1789673088.816735:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:163c450b-674a-4081-bea4-a5f6f08422e7+10:15595:x1876607714326528:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789673088.816762:0:19758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673088.816784:0:19758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cde00/0x6c78c4f8c99667b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd254e2 expref: -99 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.816874:0:19758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c99667b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.816889:0:19758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c99667b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.816902:0:19758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c99667b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.816914:0:19758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.816921:0:19758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817158:0:19758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789673088.817269:0:19758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789673088.817694:0:19758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c99667b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817733:0:19758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c99667b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817741:0:19758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c99667b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817748:0:19758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789673088.817752:0:19758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c99667b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817761:0:19758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c99667b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817774:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc45bd3200) 00010000:00010000:0.0:1789673088.817777:0:19758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789673088.817781:0:19758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c99667b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817788:0:19758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c99667b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817802:0:19758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817809:0:19758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817815:0:19758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817821:0:19758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789673088.817829:0:19758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817837:0:19758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817845:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cfb46b95d00) 00010000:00010000:0.0:1789673088.817848:0:19758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789673088.817851:0:19758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817858:0:19758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817898:0:19758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cde00/0x6c78c4f8c99667b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254e2 expref: 12 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817908:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc45bd3200) 00010000:00010000:0.0:1789673088.817910:0:19758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789673088.817914:0:19758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cde00/0x6c78c4f8c99667b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254e2 expref: 12 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.817923:0:19758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d8cde00, rc 0) 00000100:00100000:0.0:1789673088.818308:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:163c450b-674a-4081-bea4-a5f6f08422e7+11:15595:x1876607714326528:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 1574us (2092us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1789673088.818317:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 34 00000100:00100000:2.0:1789673088.826305:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673088.826481:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714326656 00000100:00100000:3.0:1789673088.826493:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714326656 00000100:00100000:3.0:1789673088.826592:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:3.0:1789673088.826602:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:163c450b-674a-4081-bea4-a5f6f08422e7+11:15595:x1876607714326656:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:3.0:1789673088.826630:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673088.826653:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99667cc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd254e9 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.826789:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c99667d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.826804:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c99667d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.826816:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c99667d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789673088.826853:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789673088.826858:0:17140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789673088.826879:0:17140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c99667d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.826909:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99667cc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254e9 expref: 13 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.826957:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c99667d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254e9 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.826964:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfb46b95600) 00010000:00010000:3.0:1789673088.826967:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789673088.826970:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb47476600, rc 0) 00000100:00100000:3.0:1789673088.827035:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:163c450b-674a-4081-bea4-a5f6f08422e7+12:15595:x1876607714326656:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 434us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673088.827041:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 35 00000100:00100000:2.0:1789673088.830808:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673088.830913:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714326784 00000100:00100000:3.0:1789673088.830924:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714326784 00000100:00100000:3.0:1789673088.830983:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:3.0:1789673088.830993:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:163c450b-674a-4081-bea4-a5f6f08422e7+12:15595:x1876607714326784:12345-192.168.201.50@tcp:37:lfs.0 00000100:00100000:3.0:1789673088.835128:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:163c450b-674a-4081-bea4-a5f6f08422e7+12:15595:x1876607714326784:12345-192.168.201.50@tcp:37:lfs.0 Request processed in 4123us (4320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673088.835143:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 3 00000100:00100000:3.0:1789673088.835888:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789673088.835909:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738528128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789673088.835980:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673088.836169:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738528128 00000100:00100000:0.0:1789673088.836177:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738528128 00000100:00100000:0.0:1789673088.836245:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789673088.836255:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738528128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789673088.836301:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789673088.836346:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738528128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673088.836354:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1789673088.837088:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789673088.837139:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738528128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789673088.837554:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789673088.837567:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738528256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789673088.837613:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789673088.837840:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738528256 00000100:00100000:2.0:1789673088.837847:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738528256 00000100:00100000:2.0:1789673088.837910:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789673088.837919:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738528256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789673088.837950:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789673088.838002:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738528256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673088.838009:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789673088.838046:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738528256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789673088.838678:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738528768:0@lo:400:kworker.0 00000100:00100000:0.0:1789673088.838727:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673088.838749:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738529280:0@lo:400:kworker.0 00000100:00100000:0.0:1789673088.838770:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673088.838791:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789673088.838797:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3635:1876607738528384:0@lo:400:kworker.0 00000100:00100000:0.0:1789673088.838822:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673088.838858:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738528896:0@lo:400:kworker.0 00000100:00100000:0.0:1789673088.838883:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673088.838900:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738529408:0@lo:400:kworker.0 00000100:00100000:0.0:1789673088.838920:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673088.839075:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738528896 00000100:00100000:0.0:1789673088.839080:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738528896 00000100:00100000:0.0:1789673088.839112:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789673088.839119:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738528896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673088.839159:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1876607738528896:12345-0@lo:400:kworker.0 Request processed in 40us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673088.839165:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789673088.839192:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1876607738528896:0@lo:400:kworker.0 00000100:00100000:0.0:1789673088.839210:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738528768 00000100:00100000:0.0:1789673088.839212:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738528768 00000100:00100000:0.0:1789673088.839241:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738529280 00000100:00100000:0.0:1789673088.839243:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738529280 00000100:00100000:0.0:1789673088.839255:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738529408 00000100:00100000:0.0:1789673088.839256:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738529408 00000100:00100000:0.0:1789673088.839269:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789673088.839274:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738528768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673088.839304:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1876607738528768:12345-0@lo:400:kworker.0 Request processed in 30us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673088.839310:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789673088.839320:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789673088.839326:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738529280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673088.839348:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1876607738529280:12345-0@lo:400:kworker.0 Request processed in 23us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673088.839353:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789673088.839363:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789673088.839368:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738529408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789673088.839390:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1876607738529408:12345-0@lo:400:kworker.0 Request processed in 23us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673088.839395:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1789673088.839419:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc7f715180 x1876607738529408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789673088.839430:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1876607738529408:0@lo:400:kworker.0 00000100:00100000:0.0:1789673088.839438:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1876607738528768:0@lo:400:kworker.0 00000100:00100000:0.0:1789673088.839446:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1876607738529280:0@lo:400:kworker.0 00000100:00100000:3.0:1789673088.839625:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738528384 00000100:00100000:3.0:1789673088.839629:0:17131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738528384 00000100:00100000:3.0:1789673088.839692:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789673088.839710:0:17131:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:3635:x1876607738528384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673088.839749:0:17131:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:056ee8fb-27c3-4ac9-bc74-a01f89cd2976+24:3635:x1876607738528384:12345-0@lo:400:kworker.0 Request processed in 51us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673088.839756:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:3.0:1789673088.839784:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789673088.839788:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789673088.839791:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789673088.839802:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738528512:0@lo:400:kworker.0 00000100:00100000:3.0:1789673088.839828:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673088.839860:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738529024:0@lo:400:kworker.0 00000100:00100000:3.0:1789673088.839885:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673088.839901:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738529536:0@lo:400:kworker.0 00000100:00100000:3.0:1789673088.839925:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673088.839953:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789673088.839959:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738528640:0@lo:400:kworker.0 00000100:00100000:3.0:1789673088.839980:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673088.839995:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7f716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738529152:0@lo:400:kworker.0 00000100:00100000:3.0:1789673088.840014:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673088.840027:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738529664:0@lo:400:kworker.0 00000100:00100000:3.0:1789673088.840046:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673088.840066:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738528512 00000100:00100000:3.0:1789673088.840070:0:17882:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738528512 00000100:00100000:3.0:1789673088.840094:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789673088.840100:0:17882:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738528512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673088.840145:0:17882:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738528512:12345-0@lo:400:kworker.0 Request processed in 44us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673088.840152:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789673088.840178:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d8de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:056ee8fb-27c3-4ac9-bc74-a01f89cd2976:3635:1876607738528384:0@lo:400:kworker.0 00000100:00100000:3.0:1789673088.840198:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738528512:0@lo:400:kworker.0 00000100:00100000:3.0:1789673088.840215:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738529536 00000100:00100000:3.0:1789673088.840219:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738529536 00000100:00100000:3.0:1789673088.840243:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738529152 00000100:00100000:3.0:1789673088.840247:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738529152 00000100:00100000:3.0:1789673088.840257:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738529664 00000100:00100000:3.0:1789673088.840260:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738529664 00000100:00100000:3.0:1789673088.840273:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789673088.840278:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738529536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673088.840312:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876607738529536:12345-0@lo:400:kworker.0 Request processed in 33us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673088.840318:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789673088.840330:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789673088.840336:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738529152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673088.840361:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876607738529152:12345-0@lo:400:kworker.0 Request processed in 25us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673088.840367:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789673088.840378:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789673088.840384:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738529664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789673088.840409:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876607738529664:12345-0@lo:400:kworker.0 Request processed in 25us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673088.840424:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1789673088.840444:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789673088.840447:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789673088.840464:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876607738529152:0@lo:400:kworker.0 00010000:00080000:3.0:1789673088.840475:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cfc462dd180 x1876607738529664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789673104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789673088.840484:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1876607738529664:0@lo:400:kworker.0 00000100:00100000:3.0:1789673088.840492:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1876607738529536:0@lo:400:kworker.0 00000100:00100000:1.0:1789673088.840799:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738529024 00000100:00100000:1.0:1789673088.840806:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738529024 00000100:00100000:1.0:1789673088.840852:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738528640 00000100:00100000:1.0:1789673088.840856:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738528640 00000100:00100000:1.0:1789673088.840877:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789673088.840884:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc7f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738529024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673088.840941:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc7f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1876607738529024:12345-0@lo:400:kworker.0 Request processed in 58us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673088.840948:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789673088.840961:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789673088.840967:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738528640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789673088.840994:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738528640:12345-0@lo:400:kworker.0 Request processed in 29us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673088.841000:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789673088.841038:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738528640:0@lo:400:kworker.0 00000100:00100000:1.0:1789673088.841048:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7f714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1876607738529024:0@lo:400:kworker.0 00000100:00080000:0.0:1789673088.841147:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789673088.841381:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673088.841447:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714327040 00000100:00100000:0.0:1789673088.841451:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714327040 00000100:00100000:0.0:1789673088.841487:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:0.0:1789673088.841495:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46af3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:163c450b-674a-4081-bea4-a5f6f08422e7+12:15595:x1876607714327040:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:0.0:1789673088.841772:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46af3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:163c450b-674a-4081-bea4-a5f6f08422e7+13:15595:x1876607714327040:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 277us (392us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789673088.841780:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 4 00000100:00100000:2.0:1789673088.911617:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673088.913550:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714327168 00000100:00100000:3.0:1789673088.913571:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714327168 00000100:00100000:3.0:1789673088.913695:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:3.0:1789673088.913727:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+11:15601:x1876607714327168:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:3.0:1789673088.913752:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673088.913775:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99667da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd254f0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.913845:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477200/0x6c78c4f8c99667e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.913860:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477200/0x6c78c4f8c99667e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.913873:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477200/0x6c78c4f8c99667e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.913884:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99667e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.913909:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99667e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.913917:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99667e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914019:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476a00/0x6c78c4f8c99667ef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914029:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476a00/0x6c78c4f8c99667ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914035:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476a00/0x6c78c4f8c99667ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789673088.914332:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789673088.914337:0:17140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789673088.914384:0:17140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476a00/0x6c78c4f8c99667ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914398:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477200/0x6c78c4f8c99667e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914405:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477200/0x6c78c4f8c99667e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914413:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477200/0x6c78c4f8c99667e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914420:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47477200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673088.914424:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477200/0x6c78c4f8c99667e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914440:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477200/0x6c78c4f8c99667e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914453:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc45bd3200) 00010000:00010000:3.0:1789673088.914456:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789673088.914460:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477200/0x6c78c4f8c99667e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914466:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477200/0x6c78c4f8c99667e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914479:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99667e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914485:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99667e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914490:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99667e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914495:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47477400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673088.914498:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99667e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914504:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99667e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914510:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cfb46b95d00) 00010000:00010000:3.0:1789673088.914513:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789673088.914515:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99667e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914530:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99667e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914558:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99667da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254f0 expref: 13 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914571:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476a00/0x6c78c4f8c99667ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254f0 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673088.914579:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfb46b95600) 00010000:00010000:3.0:1789673088.914581:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789673088.914583:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb47476a00, rc 0) 00000100:00100000:3.0:1789673088.914714:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+12:15601:x1876607714327168:12345-192.168.201.50@tcp:101:bash.0 Request processed in 940us (3048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673088.915036:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 36 00000100:00100000:1.0:1789673088.918637:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673088.918851:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714327296 00000100:00100000:2.0:1789673088.918863:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714327296 00000100:00100000:2.0:1789673088.918931:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:2.0:1789673088.918943:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:15601:x1876607714327296:12345-192.168.201.50@tcp:900:bash.0 00000100:00100000:2.0:1789673088.919412:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:15601:x1876607714327296:12345-192.168.201.50@tcp:900:bash.0 Request processed in 469us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673088.919422:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:1.0:1789673088.921804:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673088.922685:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714327552 00000100:00100000:0.0:1789673088.922707:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714327552 00000100:00100000:0.0:1789673088.922775:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 37 00000100:00100000:0.0:1789673088.922787:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+12:15601:x1876607714327552:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789673088.922810:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673088.922834:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cde00/0x6c78c4f8c99667f6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd254f7 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.922958:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.922974:0:17138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c99667d3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254e9 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.922993:0:17138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667fd lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.923029:0:17138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c99667d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254e9 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.923250:0:17138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c99667d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254e9 expref: 12 pid: 17140 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673088.923281:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc462dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17138:1876607738529792:192.168.201.50@tcp:104: 00000100:00100000:0.0:1789673088.923378:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc6595c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789673088.926943:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673088.927280:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc462dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17138:1876607738529792:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789673088.927281:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714327680 00000100:00100000:2.0:1789673088.927290:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714327680 00010000:00010000:0.0:1789673088.927312:0:17138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.927336:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c99667d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254e9 expref: 13 pid: 17140 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673088.927378:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 16 00000100:00100000:2.0:1789673088.927388:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:163c450b-674a-4081-bea4-a5f6f08422e7+13:2396:x1876607714327680:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789673088.927422:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789673088.927429:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c99667d3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254e9 expref: 13 pid: 17140 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.927440:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c99667d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254e9 expref: 13 pid: 17140 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.927467:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c99667d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254e9 expref: 13 pid: 17140 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.927480:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfb46b95600) 00010000:00010000:2.0:1789673088.927484:0:17123:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.927491:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.927497:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667fd lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673088.927627:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789673088.927747:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:163c450b-674a-4081-bea4-a5f6f08422e7+12:2396:x1876607714327680:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 359us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673088.927756:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 16 00010000:00010000:0.0:1789673088.927758:0:17138:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.927764:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.927789:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c9966804 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.927799:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c9966804 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.927807:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c9966804 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.928997:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c996680b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.929012:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c996680b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.929021:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c996680b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789673088.929043:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789673088.929071:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.929079:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667fd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.929086:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667fd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.929093:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789673088.929097:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667fd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.929106:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667fd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.929117:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfb46b95600) 00010000:00010000:0.0:1789673088.929120:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789673088.929124:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667fd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.929129:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc200/0x6c78c4f8c99667fd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789673088.929139:0:17138:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb979409 reply state 0000000022690597 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c9966804 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.929146:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c9966804 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.929159:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cfb46b95100) 00010000:00010000:0.0:1789673088.929161:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789673088.929163:0:17138:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789673088.929194:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cde00/0x6c78c4f8c99667f6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254f7 expref: 15 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.929209:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c996680b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254f7 expref: 14 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.929216:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:0.0:1789673088.929219:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789673088.929221:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7bb0b000, rc 0) 00000100:00100000:0.0:1789673088.931867:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+15:15601:x1876607714327552:12345-192.168.201.50@tcp:101:bash.0 Request processed in 9073us (10063us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789673088.931877:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 37 00000100:00100000:1.0:1789673088.948940:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673088.949076:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714327808 00000100:00100000:0.0:1789673088.949088:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714327808 00000100:00100000:0.0:1789673088.949160:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 38 00000100:00100000:0.0:1789673088.949170:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+15:15601:x1876607714327808:12345-192.168.201.50@tcp:101:bash.0 00010000:00010000:0.0:1789673088.949197:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673088.949220:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0be00/0x6c78c4f8c9966819 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd254fe expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.949297:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966820 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.949311:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.949339:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789673088.949390:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789673088.949394:0:17139:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789673088.949409:0:17139:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.949418:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.949436:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0be00/0x6c78c4f8c9966819 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254fe expref: 17 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.949450:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966820 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254fe expref: 16 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673088.949456:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:0.0:1789673088.949458:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789673088.949461:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7bb0a400, rc 0) 00000100:00100000:0.0:1789673088.949513:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+16:15601:x1876607714327808:12345-192.168.201.50@tcp:101:bash.0 Request processed in 345us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673088.949524:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 38 00000100:00100000:3.0:1789673088.953162:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673088.953318:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714328064 00000100:00100000:0.0:1789673088.953328:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714328064 00000100:00100000:0.0:1789673088.953412:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:0.0:1789673088.953423:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+16:15601:x1876607714328064:12345-192.168.201.50@tcp:35:bash.0 00000100:00100000:0.0:1789673088.953767:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+17:15601:x1876607714328064:12345-192.168.201.50@tcp:35:bash.0 Request processed in 345us (613us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789673088.953791:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 5 00000100:00100000:1.0:1789673089.038628:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673089.039290:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714328320 00000100:00100000:2.0:1789673089.039301:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714328320 00000100:00100000:2.0:1789673089.039433:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:2.0:1789673089.039446:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+17:15611:x1876607714328320:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:2.0:1789673089.039475:0:19758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673089.039497:0:19758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9966827 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25505 expref: -99 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789673089.039610:0:19758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789673089.039778:0:19758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9966827 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25505 expref: 19 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.039807:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cfc45bd3200) 00010000:00010000:2.0:1789673089.039810:0:19758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789673089.039815:0:19758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d887200/0x6c78c4f8c9966827 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25505 expref: 19 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.039833:0:19758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d887200, rc 0) 00000100:00100000:2.0:1789673089.040028:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+18:15611:x1876607714328320:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 585us (1411us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789673089.040044:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 39 00000100:00100000:1.0:1789673089.043804:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673089.044174:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714328576 00000100:00100000:3.0:1789673089.044185:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714328576 00000100:00100000:3.0:1789673089.044262:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:3.0:1789673089.044274:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+18:15611:x1876607714328576:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789673089.044535:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+19:15611:x1876607714328576:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 263us (742us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789673089.044543:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 6 00000100:00100000:3.0:1789673089.085492:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.085684:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714328832 00000100:00100000:0.0:1789673089.085706:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714328832 00000100:00100000:0.0:1789673089.085777:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 40 00000100:00100000:0.0:1789673089.085788:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+19:15614:x1876607714328832:12345-192.168.201.50@tcp:101:lfs.0 00010000:00010000:0.0:1789673089.085814:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673089.085847:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0be00/0x6c78c4f8c9966835 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2550c expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.085991:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c996683c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.086006:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c996683c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.086020:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c996683c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789673089.086032:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789673089.086139:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0be00/0x6c78c4f8c9966835 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2550c expref: 22 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.086186:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c996683c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2550c expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.086196:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:0.0:1789673089.086199:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789673089.086203:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7bb0b200, rc 0) 00000100:00100000:0.0:1789673089.086556:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+21:15614:x1876607714328832:12345-192.168.201.50@tcp:101:lfs.0 Request processed in 769us (1074us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789673089.086565:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 40 00010000:00010000:0.0:1789673089.092832:0:19759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789673089.093214:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.093396:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714328960 00000100:00100000:0.0:1789673089.093407:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714328960 00000100:00100000:0.0:1789673089.093478:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:0.0:1789673089.093489:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+21:2396:x1876607714328960:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789673089.093505:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789673089.093532:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c996683c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2550c expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.093552:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:0.0:1789673089.093557:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789673089.093625:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+20:2396:x1876607714328960:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 138us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673089.093634:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:3.0:1789673089.097299:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.097465:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714329088 00000100:00100000:0.0:1789673089.097475:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714329088 00000100:00100000:0.0:1789673089.097591:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:0.0:1789673089.097602:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+20:15614:x1876607714329088:12345-192.168.201.50@tcp:54:lfs.0 00010000:00010000:0.0:1789673089.097728:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b400/0x6c78c4f8c996684a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.097746:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b400/0x6c78c4f8c996684a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.097758:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b400/0x6c78c4f8c996684a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.097817:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b400/0x6c78c4f8c996684a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.097825:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b400/0x6c78c4f8c996684a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.097832:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b400/0x6c78c4f8c996684a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.097997:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7bb0b400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789673089.098002:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b400/0x6c78c4f8c996684a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.098011:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b400/0x6c78c4f8c996684a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.098024:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:0.0:1789673089.098027:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789673089.098041:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b400/0x6c78c4f8c996684a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.098047:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b400/0x6c78c4f8c996684a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673089.098130:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+20:15614:x1876607714329088:12345-192.168.201.50@tcp:54:lfs.0 Request processed in 530us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673089.098137:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 41 00000100:00100000:3.0:1789673089.100264:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673089.100318:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714329344 00000100:00100000:3.0:1789673089.100327:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714329344 00000100:00100000:3.0:1789673089.100387:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:3.0:1789673089.100396:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+20:15614:x1876607714329344:12345-192.168.201.50@tcp:35:lfs.0 00000100:00100000:3.0:1789673089.100592:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+21:15614:x1876607714329344:12345-192.168.201.50@tcp:35:lfs.0 Request processed in 197us (335us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789673089.100600:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 7 00000100:00100000:1.0:1789673089.412061:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673089.412228:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714329600 00000100:00100000:3.0:1789673089.412239:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714329600 00000100:00100000:3.0:1789673089.412309:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:3.0:1789673089.412319:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+21:15645:x1876607714329600:12345-192.168.201.50@tcp:101:cat.0 00010000:00010000:3.0:1789673089.412347:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673089.412365:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476e00/0x6c78c4f8c9966851 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25513 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.412485:0:17139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477800/0x6c78c4f8c9966858 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.412501:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477800/0x6c78c4f8c9966858 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.412513:0:17139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477800/0x6c78c4f8c9966858 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17139 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789673089.412524:0:17139:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789673089.412650:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476e00/0x6c78c4f8c9966851 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25513 expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.412732:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477800/0x6c78c4f8c9966858 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25513 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.412751:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:3.0:1789673089.412754:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789673089.412758:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb47477800, rc 0) 00000100:00100000:3.0:1789673089.413251:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+23:15645:x1876607714329600:12345-192.168.201.50@tcp:101:cat.0 Request processed in 932us (1199us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1789673089.413258:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 42 00000100:00100000:3.0:1789673089.415875:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673089.416396:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673089.416856:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714329984 00000100:00100000:3.0:1789673089.416865:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714329984 00000100:00100000:3.0:1789673089.416931:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:3.0:1789673089.416942:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+23:2396:x1876607714329984:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789673089.416958:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789673089.416983:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477800/0x6c78c4f8c9966858 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25513 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.416999:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:3.0:1789673089.417003:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789673089.417054:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+22:2396:x1876607714329984:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 114us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673089.417061:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:0.0:1789673089.417553:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714329856 00000100:00100000:0.0:1789673089.417557:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714329856 00000100:00100000:0.0:1789673089.417587:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:0.0:1789673089.417610:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+22:15645:x1876607714329856:12345-192.168.201.50@tcp:35:cat.0 00000100:00100000:0.0:1789673089.417969:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+23:15645:x1876607714329856:12345-192.168.201.50@tcp:35:cat.0 Request processed in 359us (2103us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1789673089.417977:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 8 00000100:00100000:1.0:1789673089.464416:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673089.464523:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714330240 00000100:00100000:2.0:1789673089.464534:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714330240 00000100:00100000:2.0:1789673089.464592:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:2.0:1789673089.464600:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+23:15650:x1876607714330240:12345-192.168.201.50@tcp:101:dd.0 00010000:00010000:2.0:1789673089.464625:0:19758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789673089.464645:0:19758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886600/0x6c78c4f8c9966866 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2551a expref: -99 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.464811:0:19758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886e00/0x6c78c4f8c996686d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.464827:0:19758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c996680b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254f7 expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.464835:0:19758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966820 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254fe expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.464863:0:19758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886e00/0x6c78c4f8c996686d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.464899:0:19758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966820 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254fe expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.464913:0:19758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966820 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254fe expref: 24 pid: 17139 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673089.464927:0:19758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a29180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19758:1876607738529920:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789673089.466281:0:19758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c996680b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254f7 expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.466297:0:19758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c996680b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254f7 expref: 24 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673089.466309:0:19758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19758:1876607738530048:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789673089.466348:0:19758:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bba3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789673089.468579:0:19758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a29180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19758:1876607738529920:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789673089.468592:0:19758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a2a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19758:1876607738530048:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789673089.468621:0:19758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886e00/0x6c78c4f8c996686d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673089.469616:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673089.469710:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.469905:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714330368 00000100:00100000:0.0:1789673089.469914:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714330368 00010000:00010000:0.0:1789673089.469951:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966820 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254fe expref: 25 pid: 17139 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673089.469997:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714330496 00000100:00100000:0.0:1789673089.470001:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714330496 00010000:00010000:0.0:1789673089.470012:0:17124:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c996680b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254f7 expref: 26 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673089.470041:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:0.0:1789673089.470050:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+26:2395:x1876607714330368:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789673089.470064:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789673089.470071:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966820 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254fe expref: 26 pid: 17139 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.470083:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966820 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254fe expref: 26 pid: 17139 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.470103:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966820 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254fe expref: 26 pid: 17139 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.470119:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:0.0:1789673089.470131:0:17124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886e00/0x6c78c4f8c996686d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.470140:0:17124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886e00/0x6c78c4f8c996686d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.470146:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789673089.470206:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+25:2395:x1876607714330368:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 156us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673089.470215:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 17 00000100:00100000:0.0:1789673089.470233:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:0.0:1789673089.470240:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc818f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+24:2395:x1876607714330496:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789673089.470248:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789673089.470252:0:17124:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c996680b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254f7 expref: 24 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.470262:0:17124:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c996680b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254f7 expref: 24 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.470274:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c996680b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd254f7 expref: 24 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.470283:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:0.0:1789673089.470287:0:17124:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886e00/0x6c78c4f8c996686d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.470294:0:17124:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886e00/0x6c78c4f8c996686d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.470311:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886e00/0x6c78c4f8c996686d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.470332:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789673089.470348:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc818f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+23:2395:x1876607714330496:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 109us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673089.470355:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00010000:00010000:2.0:1789673089.470793:0:19758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886e00/0x6c78c4f8c996686d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.470813:0:19758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886e00/0x6c78c4f8c996686d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789673089.470841:0:19758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789673089.470998:0:19758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886600/0x6c78c4f8c9966866 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2551a expref: 24 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.471016:0:19758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886e00/0x6c78c4f8c996686d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2551a expref: 23 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.471024:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:2.0:1789673089.471027:0:19758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789673089.471030:0:19758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7d886e00, rc 0) 00000100:00100000:2.0:1789673089.471068:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+23:15650:x1876607714330240:12345-192.168.201.50@tcp:101:dd.0 Request processed in 6469us (6662us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789673089.471075:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 43 00000100:00100000:1.0:1789673089.474445:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.474534:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714330624 00000100:00100000:0.0:1789673089.474545:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714330624 00000100:00100000:0.0:1789673089.474609:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:0.0:1789673089.474620:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+23:15650:x1876607714330624:12345-192.168.201.50@tcp:101:dd.0 00010000:00010000:0.0:1789673089.474645:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673089.474706:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c996687b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25521 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.474743:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0be00/0x6c78c4f8c9966882 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.474756:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0be00/0x6c78c4f8c9966882 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.474768:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0be00/0x6c78c4f8c9966882 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.474892:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c996687b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25521 expref: 25 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.474910:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0be00/0x6c78c4f8c9966882 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25521 expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.474924:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:0.0:1789673089.474927:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789673089.474931:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7bb0be00, rc 0) 00000100:00100000:0.0:1789673089.475139:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+24:15650:x1876607714330624:12345-192.168.201.50@tcp:101:dd.0 Request processed in 521us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673089.475147:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 44 00000100:00100000:3.0:1789673089.480529:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.480617:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714330880 00000100:00100000:0.0:1789673089.480625:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714330880 00000100:00100000:0.0:1789673089.480761:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 45 00000100:00100000:0.0:1789673089.480773:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+24:15650:x1876607714330880:12345-192.168.201.50@tcp:36:dd.0 00010000:00010000:0.0:1789673089.481032:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c9966889 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.481048:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c9966889 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.481057:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c9966889 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789673089.481092:0:17138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1789673089.481107:0:17138:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050ec7d23 reply state 00000000dc86cc2f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c9966889 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.481116:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c9966889 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.481121:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:0.0:1789673089.481123:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789673089.481144:0:17138:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789673089.481413:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+27:15650:x1876607714330880:12345-192.168.201.50@tcp:36:dd.0 Request processed in 642us (893us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789673089.481419:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 45 00000020:00080000:0.0:1789673089.481423:0:17138:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789673089.482581:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.482626:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714331008 00000100:00100000:0.0:1789673089.482645:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714331008 00000100:00100000:0.0:1789673089.482774:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00100000:0.0:1789673089.482784:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+27:15650:x1876607714331008:12345-192.168.201.50@tcp:101:dd.0 00010000:00010000:0.0:1789673089.482806:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673089.482819:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966890 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25528 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.482866:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966890 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25528 expref: 28 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.482875:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966890 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25528 expref: 28 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.482887:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:0.0:1789673089.482889:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789673089.482892:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7bb0a400, rc 0) 00000100:00100000:0.0:1789673089.482935:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+28:15650:x1876607714331008:12345-192.168.201.50@tcp:101:dd.0 Request processed in 153us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673089.482942:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 46 00000100:00100000:1.0:1789673089.494407:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.494971:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714331264 00000100:00100000:0.0:1789673089.494981:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714331264 00000100:00100000:0.0:1789673089.495131:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:0.0:1789673089.495143:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb4744e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+28:15650:x1876607714331264:12345-192.168.201.50@tcp:103:dd.0 00010000:00010000:0.0:1789673089.495176:0:17124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789673089.495202:0:17124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c9966890 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25528 expref: 28 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.495217:0:17124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:0.0:1789673089.495221:0:17124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789673089.495301:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb4744e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+27:15650:x1876607714331264:12345-192.168.201.50@tcp:103:dd.0 Request processed in 161us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673089.495306:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 2 00000100:00100000:1.0:1789673089.497011:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673089.497064:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714331392 00000100:00100000:2.0:1789673089.497071:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714331392 00000100:00100000:2.0:1789673089.497138:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:2.0:1789673089.497146:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+27:15650:x1876607714331392:12345-192.168.201.50@tcp:58:dd.0 00010000:00010000:2.0:1789673089.497262:0:19758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886600/0x6c78c4f8c9966897 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.497275:0:19758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886600/0x6c78c4f8c9966897 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.497283:0:19758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886600/0x6c78c4f8c9966897 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789673089.498102:0:19758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789673089.498321:0:19758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789673089.498411:0:19758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789673089.498531:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+27:15650:x1876607714331392:12345-192.168.201.50@tcp:58:dd.0 Request processed in 1378us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673089.498541:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 47 00000100:00100000:1.0:1789673089.500305:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673089.500389:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714331520 00000100:00100000:3.0:1789673089.500397:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714331520 00000100:00100000:3.0:1789673089.500441:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 48 00000100:00100000:3.0:1789673089.500452:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+27:15650:x1876607714331520:12345-192.168.201.50@tcp:101:dd.0 00010000:00010000:3.0:1789673089.500488:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673089.500511:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c996689e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2552f expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.500565:0:17139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886600/0x6c78c4f8c9966897 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.500573:0:17139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c996689e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2552f expref: 28 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.500589:0:17139:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886600/0x6c78c4f8c9966897 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.500598:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c996689e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2552f expref: 28 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.500609:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:3.0:1789673089.500612:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789673089.500614:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c996689e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2552f expref: 28 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.500619:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb47476600, rc 0) 00000100:00100000:3.0:1789673089.501377:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+28:15650:x1876607714331520:12345-192.168.201.50@tcp:101:dd.0 Request processed in 926us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673089.501384:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 48 00000040:00080000:1.0:1789673089.540620:0:17173:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789673089.540629:0:17173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789673089.540702:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789673089.540714:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789673089.540866:0:17173:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc477daa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17173:1876607738530176:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789673089.540975:0:17173:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb474650c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789673089.550922:0:17173:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc477daa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17173:1876607738530176:192.168.201.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789673089.555257:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.555383:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714331648 00000100:00100000:0.0:1789673089.555394:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714331648 00000100:00100000:0.0:1789673089.555463:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:0.0:1789673089.555474:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+28:15652:x1876607714331648:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789673089.555546:0:17138:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789673089.555893:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+28:15652:x1876607714331648:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 419us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673089.555902:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 49 00000100:00100000:0.0:1789673089.564616:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673089.564769:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714331776 00000100:00100000:3.0:1789673089.564780:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714331776 00000100:00100000:3.0:1789673089.564854:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:3.0:1789673089.564880:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+28:15652:x1876607714331776:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789673089.564960:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99668a5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.564976:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99668a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.564988:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99668a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565005:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668ac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565013:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565019:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565043:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668b3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565055:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565061:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789673089.565114:0:17140:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789673089.565119:0:17140:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789673089.565138:0:17140:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565159:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99668a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565166:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99668a5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565174:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99668a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565180:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47477400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673089.565184:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99668a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565203:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99668a5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565216:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfb46b95200) 00010000:00010000:3.0:1789673089.565219:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789673089.565225:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99668a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565231:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c99668a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565245:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565252:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668ac lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565257:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565269:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47477e00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673089.565272:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565279:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668ac lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565287:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8cfc45bd3800) 00010000:00010000:3.0:1789673089.565290:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789673089.565293:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668ac lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565299:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668ac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565313:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565318:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668b3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565325:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565330:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47476400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673089.565333:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565339:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668b3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565355:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:3.0:1789673089.565357:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789673089.565361:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668b3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.565367:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668b3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673089.565439:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+28:15652:x1876607714331776:12345-192.168.201.50@tcp:34:lhsmtool_posix.0 Request processed in 561us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673089.565446:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 50 00000100:00100000:1.0:1789673089.570352:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.570908:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714332032 00000100:00100000:0.0:1789673089.570921:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714332032 00000100:00100000:0.0:1789673089.571009:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:0.0:1789673089.571020:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+28:15652:x1876607714332032:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789673089.571043:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673089.571066:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c99668ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25536 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.571217:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c99668c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.571234:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c99668c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.571247:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c99668c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789673089.571259:0:17138:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789673089.571344:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c99668c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.571351:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c99668c1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.571359:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c99668c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.571366:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7bb0b200 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:0.0:1789673089.571371:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c99668c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.571379:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c99668c1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.571390:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:0.0:1789673089.571393:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789673089.571399:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c99668c1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.571416:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c99668c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.571462:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c99668ba lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25536 expref: 30 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.571473:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cfb46b95200) 00010000:00010000:0.0:1789673089.571476:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789673089.571480:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c99668ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25536 expref: 30 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.571490:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7bb0a400, rc 0) 00000100:00100000:0.0:1789673089.571565:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+29:15652:x1876607714332032:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 546us (1224us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1789673089.571573:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 51 00000100:00100000:1.0:1789673089.576530:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673089.576626:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714332160 00000100:00100000:3.0:1789673089.576636:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714332160 00000100:00100000:3.0:1789673089.576741:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:3.0:1789673089.576752:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+29:15652:x1876607714332160:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789673089.576792:0:17140:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789673089.576930:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+29:15652:x1876607714332160:12345-192.168.201.50@tcp:53:lhsmtool_posix.0 Request processed in 180us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673089.576938:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 52 00000100:00100000:1.0:1789673089.579802:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.580013:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714332416 00000100:00100000:0.0:1789673089.580027:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714332416 00000100:00100000:0.0:1789673089.580107:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:0.0:1789673089.580118:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+29:15652:x1876607714332416:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789673089.580141:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673089.580163:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c99668cf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2553d expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789673089.580630:0:17138:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:0.0:1789673089.580638:0:17138:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1789673089.580656:0:17138:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1789673089.580877:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c99668d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.580903:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c99668d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.580916:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c99668d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.580977:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c99668cf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2553d expref: 32 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.580997:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c99668d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2553d expref: 31 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.581005:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfb46b95f00) 00010000:00010000:0.0:1789673089.581008:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789673089.581011:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7bb0b200, rc 0) 00000100:00100000:0.0:1789673089.581068:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+31:15652:x1876607714332416:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 952us (1276us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789673089.581077:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 53 00000100:00100000:1.0:1789673089.598396:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673089.598729:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714332672 00000100:00100000:3.0:1789673089.598741:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714332672 00000100:00100000:3.0:1789673089.598818:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:3.0:1789673089.598841:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+31:15652:x1876607714332672:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789673089.598911:0:17140:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789673089.598941:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b200/0x6c78c4f8c99668d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2553d expref: 31 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599001:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfb46b95f00) 00010000:00010000:3.0:1789673089.599014:0:17140:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789673089.599043:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668e4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599058:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599069:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599086:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668eb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3868093d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599093:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3868093d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599100:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3868093d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599150:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599157:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668e4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599165:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668e4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599172:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47476400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673089.599177:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668e4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599192:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668e4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599201:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfb46b95600) 00010000:00010000:3.0:1789673089.599204:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789673089.599209:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668e4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599216:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c99668e4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599226:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668eb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3868093d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599232:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668eb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3868093d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599239:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3868093d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599244:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47477e00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673089.599246:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668eb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3868093d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599253:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668eb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3868093d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599259:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x3868093d (ffff8cfc45bd3800) 00010000:00010000:3.0:1789673089.599261:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789673089.599264:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668eb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3868093d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.599279:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c99668eb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3868093d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673089.599373:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+30:15652:x1876607714332672:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 546us (986us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789673089.599380:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 54 00000100:00100000:1.0:1789673089.603117:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.603309:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714332800 00000100:00100000:0.0:1789673089.603320:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714332800 00000100:00100000:0.0:1789673089.603388:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:0.0:1789673089.603399:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+30:15652:x1876607714332800:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789673089.603419:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673089.603445:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c99668f2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25544 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.603483:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0aa00/0x6c78c4f8c99668f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.603511:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0aa00/0x6c78c4f8c99668f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.603524:0:17138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0aa00/0x6c78c4f8c99668f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.603680:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a400/0x6c78c4f8c99668f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25544 expref: 32 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.603712:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0aa00/0x6c78c4f8c99668f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25544 expref: 31 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.603721:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfb46b95400) 00010000:00010000:0.0:1789673089.603724:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789673089.603727:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7bb0aa00, rc 0) 00000100:00100000:0.0:1789673089.603790:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+31:15652:x1876607714332800:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 393us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673089.603798:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 55 00000100:00100000:1.0:1789673089.606363:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.606962:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714333056 00000100:00100000:0.0:1789673089.606974:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714333056 00000100:00100000:0.0:1789673089.607362:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:0.0:1789673089.607373:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+31:15652:x1876607714333056:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789673089.607464:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a000/0x6c78c4f8c9966900 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.607482:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a000/0x6c78c4f8c9966900 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.607513:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a000/0x6c78c4f8c9966900 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789673089.607737:0:17140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1789673089.607750:0:17140:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 567523090117ns, next at 568523086226ns, rc = 0 00000004:00010000:0.0:1789673089.607801:0:17140:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb4d115a reply state 0000000007340560 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a000/0x6c78c4f8c9966900 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.607814:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a000/0x6c78c4f8c9966900 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.607823:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfb46b95400) 00010000:00010000:0.0:1789673089.607891:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789673089.607896:0:17140:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789673089.608227:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+33:15652:x1876607714333056:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 853us (1871us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789673089.608235:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 56 00000100:00100000:1.0:1789673089.613063:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.613127:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714333184 00000100:00100000:0.0:1789673089.613138:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714333184 00000100:00100000:0.0:1789673089.613208:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:0.0:1789673089.613218:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+33:15652:x1876607714333184:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789673089.613244:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673089.613265:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b800/0x6c78c4f8c9966907 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd2554b expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.613330:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b800/0x6c78c4f8c9966907 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2554b expref: 34 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.613370:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b800/0x6c78c4f8c9966907 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2554b expref: 34 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.613391:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfb46b95400) 00010000:00010000:0.0:1789673089.613395:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789673089.613398:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7bb0b800, rc 0) 00000100:00100000:0.0:1789673089.613602:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+34:15652:x1876607714333184:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 385us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673089.613610:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:1.0:1789673089.616627:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.620249:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714333312 00000100:00100000:0.0:1789673089.620263:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714333312 00000100:00100000:0.0:1789673089.620340:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00100000:0.0:1789673089.620349:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:2395:x1876607714333312:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789673089.620601:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:2395:x1876607714333312:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 253us (3984us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789673089.620609:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 23 00000100:00080000:1.0:1789673089.620841:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789673089.629163:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.629264:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714333568 00000100:00100000:0.0:1789673089.629274:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714333568 00000100:00100000:0.0:1789673089.629337:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:0.0:1789673089.629347:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+34:15652:x1876607714333568:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789673089.629622:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+35:15652:x1876607714333568:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 275us (469us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1789673089.629630:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 9 00000100:00100000:1.0:1789673089.631773:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673089.631852:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714333824 00000100:00100000:3.0:1789673089.631861:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714333824 00000100:00100000:3.0:1789673089.631905:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:3.0:1789673089.631914:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+35:15652:x1876607714333824:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789673089.632529:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+35:15652:x1876607714333824:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 613us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673089.632538:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:1.0:1789673089.636124:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673089.636501:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714333952 00000100:00100000:3.0:1789673089.636512:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714333952 00000100:00100000:3.0:1789673089.636612:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:3.0:1789673089.636623:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+35:15652:x1876607714333952:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789673089.636676:0:19758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789673089.636707:0:19758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c996690e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25552 expref: -99 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.636785:0:19758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966915 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.636800:0:19758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966915 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.636848:0:19758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966915 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789673089.636906:0:19758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789673089.636927:0:19758:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966915 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.636956:0:19758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c996690e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25552 expref: 37 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.636977:0:19758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966915 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25552 expref: 36 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.637395:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfb46b95400) 00010000:00010000:3.0:1789673089.637399:0:19758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789673089.637403:0:19758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb47476400, rc 0) 00000100:00100000:3.0:1789673089.637477:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+36:15652:x1876607714333952:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 856us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673089.637485:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:2.0:1789673089.639958:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673089.640138:0:19053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714334080 00000100:00100000:1.0:1789673089.640149:0:19053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714334080 00000100:00100000:1.0:1789673089.640211:0:19053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:1.0:1789673089.640222:0:19053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc47926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:2396:x1876607714334080:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789673089.640255:0:19053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789673089.640277:0:19053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c996691c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25559 expref: -99 pid: 19053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789673089.640306:0:19053:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac3e80, blocks: 0x0 00010000:00010000:1.0:1789673089.640326:0:19053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1789673089.640331:0:19053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673089.640341:0:19053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c996691c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25559 expref: 7 pid: 19053 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.640359:0:19053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c996691c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25559 expref: 7 pid: 19053 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.640374:0:19053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e4200, rc 0) 00000100:00100000:1.0:1789673089.640428:0:19053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc47926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+7:2396:x1876607714334080:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 208us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673089.640435:0:19053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 24 00000100:00100000:1.0:1789673089.643088:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673089.643176:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714334336 00000100:00100000:3.0:1789673089.643186:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714334336 00000100:00100000:3.0:1789673089.643241:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:3.0:1789673089.643251:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+36:15652:x1876607714334336:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789673089.643541:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+36:15652:x1876607714334336:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 290us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673089.643550:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 60 00000100:00100000:1.0:1789673089.645787:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673089.645933:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714334464 00000100:00100000:2.0:1789673089.645944:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714334464 00000100:00100000:2.0:1789673089.646100:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:2.0:1789673089.646111:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+36:15652:x1876607714334464:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789673089.650570:0:17118:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1789673089.650605:0:17118:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789673089.650698:0:17118:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1789673089.650934:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+19:15652:x1876607714334464:12345-192.168.201.50@tcp:44:lhsmtool_posix.0 Request processed in 4820us (5151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673089.650946:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 61 00000100:00100000:1.0:1789673089.651816:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789673089.651833:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc477db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738530304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789673089.651888:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789673089.651932:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738530304 00000100:00100000:1.0:1789673089.651938:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738530304 00000100:00100000:1.0:1789673089.651999:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789673089.652007:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1876607738530304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789673089.652164:0:18647:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789673089.652168:0:18647:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789673089.652170:0:18647:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789673089.652172:0:18647:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789673088 -> 1789673088 00002000:00010000:1.0:1789673089.652175:0:18647:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789673089.652207:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1876607738530304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (318us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789673089.652214:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789673089.652234:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789673089.652262:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cfc477db800/2, rc 0, transno 8589934596 00000100:00100000:1.0:1789673089.652267:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc477db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1876607738530304:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1789673089.653891:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966755 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.653913:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966755 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.653921:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966755 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.653927:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cc400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673089.653931:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966755 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.653940:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966755 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.653958:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cfb46b95d00) 00010000:00010000:3.0:1789673089.653961:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789673089.653966:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966755 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.653972:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cc400/0x6c78c4f8c9966755 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654012:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996675c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654018:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996675c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654023:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996675c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654026:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673089.654036:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996675c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654043:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996675c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654051:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfb46b95600) 00010000:00010000:3.0:1789673089.654054:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789673089.654057:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996675c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654063:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd000/0x6c78c4f8c996675c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654076:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c9966804 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654082:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c9966804 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654088:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c9966804 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654094:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673089.654096:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c9966804 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654102:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c9966804 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654109:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cfb46b95100) 00010000:00010000:3.0:1789673089.654112:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789673089.654122:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c9966804 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654129:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd400/0x6c78c4f8c9966804 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654145:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c9966889 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654151:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c9966889 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654158:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c9966889 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654164:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7bb0b000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673089.654167:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c9966889 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654172:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c9966889 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654180:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:3.0:1789673089.654182:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789673089.654184:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c9966889 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654367:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b000/0x6c78c4f8c9966889 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654384:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a000/0x6c78c4f8c9966900 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654400:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a000/0x6c78c4f8c9966900 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654405:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a000/0x6c78c4f8c9966900 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654410:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7bb0a000 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673089.654413:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a000/0x6c78c4f8c9966900 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654419:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a000/0x6c78c4f8c9966900 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654427:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfb46b95400) 00010000:00010000:3.0:1789673089.654429:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789673089.654432:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a000/0x6c78c4f8c9966900 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654438:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a000/0x6c78c4f8c9966900 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654484:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99667a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654493:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99667a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654499:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99667a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654505:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d8cd800 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673089.654514:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99667a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654521:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99667a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654531:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cfb46b95600) 00010000:00010000:3.0:1789673089.654533:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789673089.654536:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99667a9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.654542:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d8cd800/0x6c78c4f8c99667a9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673089.654933:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673089.655187:0:19053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714334592 00000100:00100000:1.0:1789673089.655198:0:19053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714334592 00000100:00100000:1.0:1789673089.655253:0:19053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:1.0:1789673089.655264:0:19053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+7:2395:x1876607714334592:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789673089.655385:0:19053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+7:2395:x1876607714334592:12345-192.168.201.50@tcp:16:lhsmtool_posix.0 Request processed in 122us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673089.655392:0:19053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 26 00000100:00100000:0.0:1789673089.659227:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673089.659310:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714334848 00000100:00100000:3.0:1789673089.659320:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714334848 00000100:00100000:3.0:1789673089.659390:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:3.0:1789673089.659401:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+15:15652:x1876607714334848:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789673089.659564:0:19758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789673089.659594:0:19758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966915 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25552 expref: 15 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.659623:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfb46b95400) 00010000:00010000:2.0:1789673089.659628:0:19758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789673089.659698:0:19758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886a00/0x6c78c4f8c9966923 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.659714:0:19758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886a00/0x6c78c4f8c9966923 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.659725:0:19758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886a00/0x6c78c4f8c9966923 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789673089.659898:0:19758:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004cf5a73 reply state 000000001145d363 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886a00/0x6c78c4f8c9966923 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.659911:0:19758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886a00/0x6c78c4f8c9966923 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.659917:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfb46b95400) 00010000:00010000:2.0:1789673089.659924:0:19758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789673089.659927:0:19758:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789673089.660042:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+16:15652:x1876607714334848:12345-192.168.201.50@tcp:36:lhsmtool_posix.0 Request processed in 643us (825us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789673089.660050:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 62 00000100:00100000:0.0:1789673089.664963:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:1.0:1789673089.665235:0:18647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714334976 00000100:00100000:1.0:1789673089.665246:0:18647:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714334976 00000100:00100000:1.0:1789673089.665357:0:18647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:1.0:1789673089.665369:0:18647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+7:15652:x1876607714334976:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789673089.665389:0:18647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789673089.665408:0:18647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c996692a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25560 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.665465:0:18647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c996691c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25559 expref: 8 pid: 19053 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.665475:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673089.665481:0:18647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789673089.665486:0:18647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c996692a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25560 expref: 8 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.665522:0:18647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c996691c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25559 expref: 8 pid: 19053 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.665537:0:18647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c996691c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25559 expref: 8 pid: 19053 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673089.665551:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc477d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18647:1876607738530432:192.168.201.50@tcp:104: 00000100:00100000:1.0:1789673089.665637:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb474653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789673089.668252:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673089.669267:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714335104 00000100:00100000:2.0:1789673089.669279:0:18673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714335104 00010000:00010000:2.0:1789673089.669327:0:18673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c996691c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25559 expref: 9 pid: 19053 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673089.669363:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:2.0:1789673089.669374:0:18673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+9:2395:x1876607714335104:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789673089.669390:0:18673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789673089.669416:0:18673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c996691c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25559 expref: 9 pid: 19053 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.669439:0:18673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c996691c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25559 expref: 9 pid: 19053 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.669489:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789673089.669495:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789673089.669502:0:18673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c996692a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25560 expref: 9 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.669514:0:18673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c996692a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25560 expref: 9 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.669555:0:18673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c996692a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25560 expref: 9 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673089.669572:0:18673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a29180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:18673:1876607738530560:192.168.201.50@tcp:105: 00000100:00100000:2.0:1789673089.669695:0:18673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bba000 going to sleep for 11 seconds 00010000:00010000:0.0:1789673089.670577:0:18647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a66482d/0x6c78c4f8c996691c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25559 expref: 9 pid: 19053 timeout: 667 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673089.670597:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc477d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18647:1876607738530432:192.168.201.50@tcp:104: 00010000:00010000:0.0:1789673089.670627:0:18647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c996692a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25560 expref: 8 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.670639:0:18647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfb482e4800, rc 0) 00000100:00100000:0.0:1789673089.670782:0:18647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+8:15652:x1876607714334976:12345-192.168.201.50@tcp:101:lhsmtool_posix.0 Request processed in 5415us (5828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673089.670792:0:18647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 27 00000100:00100000:2.0:1789673089.671779:0:18673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a29180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:18673:1876607738530560:192.168.201.50@tcp:105: 00010000:00010000:2.0:1789673089.671798:0:18673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789673089.671886:0:18673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+7:2395:x1876607714335104:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 2513us (3642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673089.671896:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:1.0:1789673089.672785:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673089.672916:0:19053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714335232 00000100:00100000:2.0:1789673089.672924:0:19053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714335232 00000100:00100000:2.0:1789673089.672973:0:19053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:2.0:1789673089.672986:0:19053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc477d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+7:2396:x1876607714335232:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789673089.673153:0:19053:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789673089.673157:0:19053:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789673088 00002000:00010000:2.0:1789673089.673178:0:19053:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789673087 00002000:00010000:2.0:1789673089.673181:0:19053:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789673088 -> 1789673088 00002000:00010000:2.0:1789673089.673183:0:19053:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789673089.673273:0:19053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc477d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+8:2396:x1876607714335232:12345-192.168.201.50@tcp:2:lhsmtool_posix.0 Request processed in 291us (491us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789673089.673283:0:19053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 28 00000100:00100000:1.0:1789673089.679719:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673089.680762:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714335360 00000100:00100000:2.0:1789673089.680774:0:18648:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714335360 00000100:00100000:2.0:1789673089.680935:0:18648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:2.0:1789673089.680948:0:18648:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+8:2395:x1876607714335360:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789673089.680999:0:18648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be352c43/0x6c78c4f8c9966931 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.681020:0:18648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c996692a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25560 expref: 8 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.681029:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789673089.681034:0:18648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789673089.681038:0:18648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be352c43/0x6c78c4f8c9966931 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.681075:0:18648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c996692a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25560 expref: 8 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.681092:0:18648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c996692a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25560 expref: 8 pid: 18647 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673089.681131:0:18648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfb47a29180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18648:1876607738530688:192.168.201.50@tcp:104: 00000100:00100000:2.0:1789673089.681227:0:18648:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bba000 going to sleep for 11 seconds 00000100:00100000:1.0:1789673089.684395:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673089.684759:0:18648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfb47a29180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18648:1876607738530688:192.168.201.50@tcp:104: 00010000:00010000:2.0:1789673089.684790:0:18648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000be352c43/0x6c78c4f8c9966931 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673089.684983:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714335488 00000100:00100000:3.0:1789673089.684990:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714335488 00010000:00010000:3.0:1789673089.685031:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c996692a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25560 expref: 9 pid: 18647 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673089.685073:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:3.0:1789673089.685083:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+9:2396:x1876607714335488:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789673089.685099:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789673089.685125:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c996692a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25560 expref: 9 pid: 18647 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.685159:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c996692a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25560 expref: 9 pid: 18647 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.685183:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059ce6f64/0x6c78c4f8c996692a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25560 expref: 9 pid: 18647 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.685201:0:17125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789673089.685206:0:17125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789673089.685211:0:17125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be352c43/0x6c78c4f8c9966931 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.685219:0:17125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be352c43/0x6c78c4f8c9966931 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.685248:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789673089.685304:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+8:2396:x1876607714335488:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 221us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673089.685312:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00010000:00010000:2.0:1789673089.686015:0:18648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000be352c43/0x6c78c4f8c9966931 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.686028:0:18648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be352c43/0x6c78c4f8c9966931 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.686052:0:18648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000be352c43/0x6c78c4f8c9966931 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.686062:0:18648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be352c43/0x6c78c4f8c9966931 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.686071:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be352c43/0x6c78c4f8c9966931 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.686079:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d887200 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:2.0:1789673089.686084:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be352c43/0x6c78c4f8c9966931 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.686105:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be352c43/0x6c78c4f8c9966931 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.686119:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be352c43/0x6c78c4f8c9966931 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.686128:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be352c43/0x6c78c4f8c9966931 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673089.686194:0:18648:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+7:2395:x1876607714335360:12345-192.168.201.50@tcp:1:lhsmtool_posix.0 Request processed in 5249us (6535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673089.686203:0:18648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 29 00000100:00100000:1.0:1789673089.696729:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673089.696820:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714335744 00000100:00100000:3.0:1789673089.696834:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714335744 00000100:00100000:3.0:1789673089.696891:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 63 00000100:00100000:3.0:1789673089.696901:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+16:15652:x1876607714335744:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789673089.696984:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966938 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.697016:0:17140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0be00/0x6c78c4f8c9966882 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25521 expref: 16 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.697027:0:17140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966938 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.697063:0:17140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0be00/0x6c78c4f8c9966882 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25521 expref: 16 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.697076:0:17140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0be00/0x6c78c4f8c9966882 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25521 expref: 16 pid: 17140 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673089.697092:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd42300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17140:1876607738530816:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789673089.697180:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bbba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789673089.704396:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd42300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17140:1876607738530816:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789673089.704452:0:17140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966938 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673089.706713:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673089.707108:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714335872 00000100:00100000:2.0:1789673089.707120:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714335872 00010000:00010000:2.0:1789673089.707166:0:17123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0be00/0x6c78c4f8c9966882 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25521 expref: 17 pid: 17140 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789673089.707211:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:2.0:1789673089.707222:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc41219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+17:2395:x1876607714335872:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789673089.707238:0:17123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789673089.707246:0:17123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0be00/0x6c78c4f8c9966882 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25521 expref: 17 pid: 17140 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.707260:0:17123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0be00/0x6c78c4f8c9966882 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25521 expref: 17 pid: 17140 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.707305:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0be00/0x6c78c4f8c9966882 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25521 expref: 17 pid: 17140 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.707322:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:2.0:1789673089.707328:0:17123:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c996689e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2552f expref: 16 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.707339:0:17123:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966938 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.707348:0:17123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966938 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.707355:0:17123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966938 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673089.707388:0:17123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789673089.707779:0:17140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966938 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.707789:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966938 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.708012:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c996693f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.708027:0:17140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b800/0x6c78c4f8c9966907 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2554b expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.708042:0:17140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c996693f lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.708071:0:17140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b800/0x6c78c4f8c9966907 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2554b expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.708085:0:17140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b800/0x6c78c4f8c9966907 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2554b expref: 17 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673089.708101:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd42300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17140:1876607738530944:192.168.201.50@tcp:104: 00000100:00100000:3.0:1789673089.708179:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bbb480 going to sleep for 11 seconds 00000100:00100000:2.0:1789673089.708267:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc41219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+17:2395:x1876607714335872:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 1046us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673089.708276:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 21 00000100:00100000:1.0:1789673089.711976:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673089.712152:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd42300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17140:1876607738530944:192.168.201.50@tcp:104: 00010000:00010000:3.0:1789673089.712190:0:17140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c996693f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673089.712413:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714336000 00000100:00100000:0.0:1789673089.712422:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714336000 00010000:00010000:0.0:1789673089.712462:0:17125:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b800/0x6c78c4f8c9966907 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2554b expref: 17 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673089.712494:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 22 00000100:00100000:0.0:1789673089.712501:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+17:2396:x1876607714336000:12345-192.168.201.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789673089.712532:0:17125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789673089.712540:0:17125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b800/0x6c78c4f8c9966907 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2554b expref: 17 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.712554:0:17125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b800/0x6c78c4f8c9966907 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2554b expref: 17 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.712577:0:17125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b800/0x6c78c4f8c9966907 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2554b expref: 17 pid: 17138 timeout: 667 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.712596:0:17125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfb46b95400) 00010000:00010000:0.0:1789673089.712601:0:17125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c996693f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.712612:0:17125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c996693f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.712620:0:17125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c996693f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.712654:0:17125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789673089.712759:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+16:2396:x1876607714336000:12345-192.168.201.50@tcp:103:ldlm_bl.0 Request processed in 256us (791us total) trans 0 rc 0/0 00010000:00010000:3.0:1789673089.712761:0:17140:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c996693f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673089.712774:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 22 00010000:00010000:3.0:1789673089.712775:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c996693f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789673089.712897:0:17140:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1789673089.713020:0:17140:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1789673089.713058:0:17140:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1789673089.713134:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd42300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17140:1876607738531072:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789673089.713185:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673089.713223:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bbbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789673089.713413:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738531072 00000100:00100000:0.0:1789673089.713419:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738531072 00000100:00100000:0.0:1789673089.713472:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789673089.713480:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17140:x1876607738531072:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789673089.713568:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17140:x1876607738531072:12345-0@lo:1000:mdt00_002.0 Request processed in 89us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673089.713583:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789673089.713610:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd42300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17140:1876607738531072:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789673089.713808:0:17140:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1789673089.713850:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd42300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17140:1876607738531200:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789673089.713879:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673089.713951:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfc45bbb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789673089.716207:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738531200 00000100:00100000:0.0:1789673089.716222:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738531200 00000100:00100000:0.0:1789673089.716339:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789673089.716351:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17140:x1876607738531200:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789673089.716735:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17140:x1876607738531200:12345-0@lo:1000:mdt00_002.0 Request processed in 385us (2854us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789673089.716743:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789673089.716933:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd42300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17140:1876607738531200:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789673089.717002:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c996693f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.717013:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c996693f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.717021:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c996693f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.717028:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47477400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789673089.717033:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c996693f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.717040:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c996693f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.717056:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfb46b95400) 00010000:00010000:1.0:1789673089.717059:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789673089.717065:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c996693f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.717071:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477400/0x6c78c4f8c996693f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.717108:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886600/0x6c78c4f8c9966897 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.717115:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886600/0x6c78c4f8c9966897 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.717121:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886600/0x6c78c4f8c9966897 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.717137:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7d886600 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:1.0:1789673089.717140:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886600/0x6c78c4f8c9966897 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.717146:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886600/0x6c78c4f8c9966897 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.717155:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:1.0:1789673089.717157:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789673089.717164:0:17140:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c996689e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2552f expref: 19 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.717175:0:17140:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c996689e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2552f expref: 19 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.717184:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c996689e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2552f expref: 19 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.717244:0:17140:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476600/0x6c78c4f8c996689e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd2552f expref: 19 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673089.717259:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17140:1876607738531328:192.168.201.50@tcp:105: 00000100:00100000:1.0:1789673089.717342:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cfb47465240 going to sleep for 11 seconds 00000100:00100000:1.0:1789673089.723218:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.723301:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714336128 00000100:00100000:0.0:1789673089.723310:0:17142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714336128 00000100:00100000:3.0:1789673089.723326:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17140:1876607738531328:192.168.201.50@tcp:105: 00010000:00010000:3.0:1789673089.723357:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886600/0x6c78c4f8c9966897 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723369:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7d886600/0x6c78c4f8c9966897 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673089.723371:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 10 00000100:00100000:0.0:1789673089.723385:0:17142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb46af0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+20:15650:x1876607714336128:12345-192.168.201.50@tcp:49:dd.0 00010000:00010000:3.0:1789673089.723411:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966946 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723425:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966946 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723448:0:17140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966946 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723459:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966946 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723466:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966946 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723473:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966946 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723480:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47476400 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673089.723498:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966946 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723507:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966946 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723520:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:3.0:1789673089.723523:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789673089.723527:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966946 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723534:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47476400/0x6c78c4f8c9966946 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723544:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966938 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723551:0:17140:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966938 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723557:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966938 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723563:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47477e00 already unused, calling callback (ffffffffc188e4f0) 00010000:00010000:3.0:1789673089.723566:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966938 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723573:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966938 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723581:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:3.0:1789673089.723584:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789673089.723594:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966938 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.723601:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb47477e00/0x6c78c4f8c9966938 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17140 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673089.723879:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10bccd63-9b9d-4821-aed0-aaa14fbada75+20:15652:x1876607714335744:12345-192.168.201.50@tcp:57:lhsmtool_posix.0 Request processed in 26978us (27160us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1789673089.723891:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 63 00000020:00080000:3.0:1789673089.723896:0:17140:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789673089.723921:0:17142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb46af0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+19:15650:x1876607714336128:12345-192.168.201.50@tcp:49:dd.0 Request processed in 537us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673089.723931:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 10 00000040:00080000:2.0:1789673089.724281:0:17173:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789673089.724286:0:17173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789673089.724323:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789673089.724331:0:17173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789673089.727823:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673089.727875:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.728046:0:19758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714336256 00000100:00100000:0.0:1789673089.728117:0:19758:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714336256 00000100:00100000:1.0:1789673089.728141:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714336512 00000100:00100000:1.0:1789673089.728148:0:17141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714336512 00000100:00100000:0.0:1789673089.728225:0:19758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 64 00000100:00100000:0.0:1789673089.728239:0:19758:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+20:15650:x1876607714336256:12345-192.168.201.50@tcp:101:dd.0 00000100:00100000:1.0:1789673089.728245:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 11 00000100:00100000:1.0:1789673089.728261:0:17141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+20:15652:x1876607714336512:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 00010000:00010000:0.0:1789673089.728267:0:19758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789673089.728292:0:19758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b800/0x6c78c4f8c996694d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x12e7d0344bd25567 expref: -99 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.728329:0:19758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a800/0x6c78c4f8c9966954 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.728357:0:19758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a800/0x6c78c4f8c9966954 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.728370:0:19758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a800/0x6c78c4f8c9966954 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.728466:0:19758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0b800/0x6c78c4f8c996694d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25567 expref: 23 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.728487:0:19758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfc7bb0a800/0x6c78c4f8c9966954 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.50@tcp remote: 0x12e7d0344bd25567 expref: 22 pid: 19758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.728496:0:19758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cfb46b95b00) 00010000:00010000:0.0:1789673089.728499:0:19758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789673089.728503:0:19758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cfc7bb0a800, rc 0) 00000100:00100000:0.0:1789673089.728577:0:19758:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+22:15650:x1876607714336256:12345-192.168.201.50@tcp:101:dd.0 Request processed in 341us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673089.728585:0:19758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 64 00000004:00080000:1.0:1789673089.728592:0:17141:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789673089.728628:0:17141:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1789673089.728692:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c996695b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.728705:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c996695b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.728714:0:17141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c996695b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.728722:0:17141:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c996695b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.728729:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c996695b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.728735:0:17141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c996695b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789673089.728759:0:17141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789673089.728804:0:17126:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789673089.728813:0:17126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c996695b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673089.728820:0:17141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+22:15652:x1876607714336512:12345-192.168.201.50@tcp:35:lhsmtool_posix.0 Request processed in 563us (942us total) trans 8589934622 rc 0/0 00010000:00010000:3.0:1789673089.728825:0:17126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb482e4600 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789673089.728831:0:17126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c996695b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789673089.728832:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 11 00000020:00080000:1.0:1789673089.728839:0:17141:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789673089.728844:0:17126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c996695b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.728858:0:17126:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cfb46b95400) 00010000:00010000:3.0:1789673089.728860:0:17126:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789673089.728864:0:17126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c996695b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.728870:0:17126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cfb482e4600/0x6c78c4f8c996695b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17141 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673089.728882:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673089.728883:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789673089.728885:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789673089.919446:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673089.919497:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673089.919764:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714336768 00000100:00100000:0.0:1789673089.919774:0:18652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714336768 00000100:00100000:0.0:1789673089.919847:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714336640 00000100:00100000:0.0:1789673089.919851:0:18652:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714336640 00000100:00100000:0.0:1789673089.919874:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:0.0:1789673089.919883:0:18652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+8:2398:x1876607714336768:12345-192.168.201.50@tcp:4:dd.0 00002000:00010000:0.0:1789673089.919942:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aac3e80, atime: 0x6aac3e7f, ctime: 0x6aac3e80, blocks: 0x0 00010000:00010000:0.0:1789673089.919952:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b51072f9/0x6c78c4f8c9966962 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.919980:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1789673089.919985:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789673089.919991:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b51072f9/0x6c78c4f8c9966962 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789673089.920006:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b51072f9/0x6c78c4f8c9966962 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789673090.004350:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673090.004399:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:0.0:1789673090.004438:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673090.004469:0:19053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714337152 00000100:00100000:0.0:1789673090.004479:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714337408 00000100:00100000:2.0:1789673090.004485:0:19053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714337152 00000100:00100000:0.0:1789673090.004486:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714337408 00000100:00100000:1.0:1789673090.004568:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714336896 00000100:00100000:1.0:1789673090.004573:0:17132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714336896 00000100:00100000:1.0:1789673090.004634:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 167 00000100:00100000:1.0:1789673090.004646:0:17132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc81585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:2397:x1876607714336896:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:3.0:1789673090.004867:0:17132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc81585450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:027bcf1b-b718-4fc6-8a0f-0cff3993e488+13:2397:x1876607714336896:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 211us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673090.004883:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 167 00000100:00100000:3.0:1789673090.007841:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673090.008318:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673090.008367:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:3.0:1789673090.008404:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714337536 00000100:00100000:3.0:1789673090.008414:0:18646:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714337536 00000100:00100000:2.0:1789673090.014476:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714337024 00000100:00100000:2.0:1789673090.014503:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714337024 00000100:00100000:2.0:1789673090.014549:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714337280 00000100:00100000:2.0:1789673090.014553:0:17140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714337280 00000100:00100000:2.0:1789673090.014584:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:1.0:1789673090.014598:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00100000:2.0:1789673090.014600:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:163c450b-674a-4081-bea4-a5f6f08422e7+5:2397:x1876607714337408:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:1.0:1789673090.014622:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:2398:x1876607714337024:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789673090.014729:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:163c450b-674a-4081-bea4-a5f6f08422e7+5:2397:x1876607714337408:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 135us (10290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673090.014737:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 57 00000100:00100000:2.0:1789673090.014805:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:2.0:1789673090.014812:0:17140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:163c450b-674a-4081-bea4-a5f6f08422e7+6:2398:x1876607714337280:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789673090.014870:0:17140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:163c450b-674a-4081-bea4-a5f6f08422e7+6:2398:x1876607714337280:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 57us (6552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673090.014876:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 59 00000100:00100000:1.0:1789673090.017159:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:2398:x1876607714337024:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 2524us (9314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789673090.017178:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 58 00000100:00080000:0.0:1789673090.018207:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789673090.018218:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789673090.018222:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789673090.018225:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789673090.018331:0:19053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:0.0:1789673090.018346:0:19053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc462dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:2397:x1876607714337152:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:0.0:1789673090.018439:0:19053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc462dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:2397:x1876607714337152:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 99us (14038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673090.018447:0:19053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 18 00000100:00100000:3.0:1789673090.019827:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 19 00000100:00100000:2.0:1789673090.021257:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.50@tcp (source: 12345-192.168.201.50@tcp) 00000100:00100000:2.0:1789673090.021303:0:19053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607714337664 00000100:00100000:2.0:1789673090.021314:0:19053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607714337664 00000100:00100000:2.0:1789673090.021380:0:19053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:2.0:1789673090.021391:0:19053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:163c450b-674a-4081-bea4-a5f6f08422e7+5:2397:x1876607714337664:12345-192.168.201.50@tcp:400:kworker.0 00000100:00100000:2.0:1789673090.021480:0:19053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:163c450b-674a-4081-bea4-a5f6f08422e7+5:2397:x1876607714337664:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 91us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789673090.021489:0:19053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 20 00000100:00100000:3.0:1789673090.021729:0:18646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:163c450b-674a-4081-bea4-a5f6f08422e7+5:2398:x1876607714337536:12345-192.168.201.50@tcp:400:kworker.0 00000100:00080000:0.0:1789673090.021745:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789673090.021935:0:18646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:163c450b-674a-4081-bea4-a5f6f08422e7+5:2398:x1876607714337536:12345-192.168.201.50@tcp:400:kworker.0 Request processed in 2094us (13565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673090.021947:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 19 00000001:00080000:0.0:1789673090.050204:0:18642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1789673090.050223:0:18642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:3.0:1789673090.050427:0:18652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:3.0:1789673090.050559:0:18652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:3.0:1789673090.050579:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b51072f9/0x6c78c4f8c9966962 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673090.050593:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b51072f9/0x6c78c4f8c9966962 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673090.050601:0:18652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b51072f9/0x6c78c4f8c9966962 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673090.050608:0:18652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfc7bb0bc00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789673090.050613:0:18652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b51072f9/0x6c78c4f8c9966962 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673090.050644:0:18652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b51072f9/0x6c78c4f8c9966962 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673090.050698:0:18652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b51072f9/0x6c78c4f8c9966962 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673090.050707:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b51072f9/0x6c78c4f8c9966962 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673090.050881:0:18652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+6:2398:x1876607714336768:12345-192.168.201.50@tcp:4:dd.0 Request processed in 130993us (131439us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789673090.050898:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 0 00000100:00100000:3.0:1789673090.050933:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:3.0:1789673090.050946:0:18652:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:2398:x1876607714336640:12345-192.168.201.50@tcp:4:dd.0 00002000:00010000:3.0:1789673090.050986:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6aac3e80, atime: 0x6aac3e7f, ctime: 0x6aac3e80, blocks: 0x1a68 00010000:00010000:3.0:1789673090.050994:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec79e6c5/0x6c78c4f8c9966969 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673090.051006:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1789673090.051012:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789673090.051018:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec79e6c5/0x6c78c4f8c9966969 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673090.051030:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec79e6c5/0x6c78c4f8c9966969 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789673090.115933:0:17127:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789673090.134918:0:18642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:3.0:1789673090.135161:0:18652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:3.0:1789673090.135181:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec79e6c5/0x6c78c4f8c9966969 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673090.135195:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec79e6c5/0x6c78c4f8c9966969 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673090.135205:0:18652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec79e6c5/0x6c78c4f8c9966969 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673090.135213:0:18652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cfb47476e00 already unused, calling callback (ffffffffc0c468b0) 00010000:00010000:3.0:1789673090.135218:0:18652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec79e6c5/0x6c78c4f8c9966969 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673090.135227:0:18652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec79e6c5/0x6c78c4f8c9966969 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673090.135246:0:18652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec79e6c5/0x6c78c4f8c9966969 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789673090.135253:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec79e6c5/0x6c78c4f8c9966969 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789673090.135528:0:18652:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:10bccd63-9b9d-4821-aed0-aaa14fbada75+5:2398:x1876607714336640:12345-192.168.201.50@tcp:4:dd.0 Request processed in 84581us (216025us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789673090.135539:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.50@tcp, seq: 1 00000100:00100000:1.0:1789673090.884896:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc4cd40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738531456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789673090.885055:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789673090.885388:0:18649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738531456 00000100:00100000:3.0:1789673090.885398:0:18649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738531456 00000100:00100000:3.0:1789673090.886153:0:18649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789673090.886165:0:18649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738531456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789673090.886193:0:18649:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00080000:1.0:1789673090.886286:0:17134:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789673090.887072:0:18649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4121a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1876607738531456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 906us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789673090.887083:0:18649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789673090.887430:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc4cd40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1876607738531456:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789673091.145593:0:19759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789673091.408509:0:20318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1789673091.908220:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789673091.909812:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789673091.909838:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc41218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738531712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789673091.909918:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673091.910524:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738531712 00000100:00100000:0.0:1789673091.910534:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738531712 00000100:00100000:0.0:1789673091.910606:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789673091.910616:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfc4cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738531712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789673091.910709:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789673091.910771:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfc4cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876607738531712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673091.910778:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789673091.911059:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc41218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1876607738531712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789673091.913466:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cfc7d93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738531584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789673091.913640:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789673091.914026:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876607738531584 00000100:00100000:0.0:1789673091.914037:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876607738531584 00000100:00100000:0.0:1789673091.914100:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789673091.914110:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cfb47a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738531584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789673091.914149:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789673091.914832:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cfb47a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876607738531584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 720us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789673091.914841:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789673091.917489:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cfc7d93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1876607738531584:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789673092.164577:0:17126:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42537 lines, 42537 kept, 0 dropped, 0 bad.